I will build data engineering pipelines

About This Gig

I can help build data pipelines either a small part or the whole pipeline which might include talking to data via Python, Spark, SQL, AWS/Azure.

Services Provided:

Big Data and Cloud Data Hub Implementation​ 

Data warehousing and Business Intelligence

Data Integration - ETL Batch, Real Time Streaming and Data Services

Data Visualization

Data Cleaning

Data Quality

Data Enrichment

ETL

Tech Expertise:

Python

SQL

Big Data Tech (Apache Spark, Hadoop, Hive, Kafka)

AWS (S3, Glue, Redshift, Athena, Lambda, Lake Formation, Step Functions, DynamoDB, Event Bridge, EC2, RDS, IOT Core, Kinesis, Quicksight)

Azure (Azure Databricks, Blob, ADLS, ADF, Event Hubs, Functions, Synapse, CosmosDB, SQL Database)

GCP (Dataproc, GCS Buckets, Functions, BigQuery, PubSub, CloudSQL, Cloud Spanner)

Please send me a message before ordering to understand how your problems can be solved! Thank you!