Loading...

Hello & Welcome!

I Am

About Me

  • Data Engineer
  • Big Data Consultant
  • Enterprise Developer

Hands-on data engineer with a proven record of deploying scalable distributed applications, and supporting data science forecasting applications in production. Experienced in a variety of engineering technologies and model evaluation techniques.

Happy Clients

Kal Tire

May 2022 - Present

Automating the process of identifying faulty tires and alerting the client to submit a new work order from Infor EAM

Develop and manage ETL workflow using Infor ION Workflow

Working on the integration of Smart Asset Management (SAM) with the client's on-premise Infor EAM system

Refactoring the codebase to keep up with the latest reference architecture and reduce technical debt

Coordinating with solution architects to solidify the data flows between Infor CloudSuite products (SAM, EAM, Birst, Data Lake, etc.)

Working closely with data scientists, business analysts and product owners on data-related technical issues and their data needs

Pilot Flying J

Jan 2022 - April 2022

Lead the delivery and integration of the Smart Forecasting Management solution with the client's Infor CloudSuite tenant

Implemented a parallel architecture to run multiple Spark jobs on a partitioned data set for better ML predictions

Collaborated with solution architects from other Infor teams to integrate Data Fabric platform functionalities into the final solution

Improved the logging and monitoring of the solution and configured performance degradation and failures alerts

Wrote technical documentation on the architecture and data transformations, and trained the data scientists to use it for ML tuning

Put in place coding practices and deployment processes for the team to streamline the development and release cycles

EMCO

October 2021 - December 2021

Lead the delivery and integration of the Pricing Intelligence solution with the client's Infor CloudSuite tenant.

Put in place metrics and processes for validating the quality of the inbound and outbound data.

Contributed to the development road map of Infor Coleman by writing feature requests and bug reports to speed up the solution delivery.

Collaborated with multiple stakeholders like data scientists, business analysts and product owners to quickly solve technical issues and ensure good communication with the clients.

Wrote and reviewed technical documentation, data interface specifications, and extension guides.

Optimus (Internal tooling)

February 2020 - Sep 2021

Maintained a platform for running Spark applications on managed cloud services, mainly on AWS

Developed Spark applications to make the bootstrapping of Infor products faster and repeatable. The applications cover data transformation, schema and constraints validation, outlier detection and ML. The time-to-delivery dropped from 15-20 business days to 2-4, and the forecast tuning from 5-10 business days to several hours

Designed, scheduled and monitored data pipelines using Airflow on AWS MWAA

Established coding best practices (pair code reviews, code linting configuration, git hooks, etc.)

Adopted Semantic Versioning as our versioning policy for the releases to reduce the risk of breaking software for existing clients

Wrote technical documentation on the internals of the system and how-to guides to make the onboarding of engineers easy

Setup CI/CD pipelines to build, test, package and publish each artifact

Market leader processor of meat and convenience products in Switzerland

December 2019 - February 2020

Drove the technical discussions with the client around integration and data interface specification of Demand Management

Assisted in the Exploratory Data Analysis by running a data profiling pipeline to identify patterns and get metrics and statistics.

Developed SQL transformations to map the client's data specs to be ingested into Demand Management.

Performed end-to-end testing of the solution: transformation of the data, ingestion into Demand Management, and generation of the ML forecast.

Designed a forecast assessment pipeline to evaluate the previous forecast outputs of the ML engine against the incoming data containing the actual sales.

Integrated the Demand Management solution with the Infor SCP to automate the creation and review of work orders.

Prepared a workspace in Infor Birst to visualize the results of the EDA and the generated ML forecast.

Largest retail group operating in New Zealand [PoC]

October 2019 - November 2019

Took part in technical discussions and worked closely with the Demand Management development and support teams.

Validated the inbound client data against a list of constraints (primary keys, completeness, datatypes, etc.) and ran data profiling to complement Exploratory Data Analysis

Performed end-to-end testing of the solution: ingestion into Demand Management, and generation of Time Series and ML forecasts

Monitored the workflows and optimized the predicates queries for better performance to meet SLAs

Wrote technical documentation covering the high-level architecture of the solution, integration with external systems, batch operations, and data interface specifications

Australia’s fastest growing discount pharmacy chain [PoC]

August 2019 - September 2019

Setup integration with the client on-premise SQL Server to pull data from relational tables.

Developed data transformations to map the client data into the data specification of Demand Management.

Performed end-to-end testing of the solution: from data transformation, ingestion into Demand Management, and generation of the final ML forecast.

Monitored the workflows and optimized the predicates queries for better performance to meet SLAs.

Wrote technical documentation covering the high-level architecture of the solution, integration with external systems, batch operations, and data interface specifications.

Demand Management

March 2019 - Jan 2020

Responsible for the build and packaging of the Demand Management Nix-based image using the LogicBlox platform

Designed data models and hierarchy structures using LogiQL predicates in the LogicBlox OLTP database

Improved system and batch performance by tuning the application design and optimizing queries

Implemented workflows using the Logicblox workflow DSL for bootstrapping the application, ingesting data, and generating Time Series forecast, ML predictions, and replenishment reports

Managed multiple clusters for different releases: dev, UAT, predeployed, and production

Worked with multiple teams and stakeholders: Cloud OPS, DevOPS, Application Support, and Business Consultancy

Testimonials

Get In Touch

Call Me On

+21652456619

Email Me At

contact@hedibejaoui.me

2022 © Hedi Bejaoui.