Data Engineering

Full stack data services:

  • Data Migration
  • Integration
  • Data Quality & Cleansing
  • Real-time Streaming
  • Big & Distributed Data
  • Data Modelling
  • Data Warehousing

Tools typically used:

  • AWS Data Engineering Stack
  • Microsoft SQL Server & Data Services: SSIS, SSAS, SSRS
  • Microsoft Azure & Fabric
  • Apache Spark, Hadoop, & Unix Distirbuted Architecture
  • PostgreSQL & Other Relational Databases
  • SnowFlake & RedShift
  • Clickhouse & others

Data Engineering Example

A data exploration of stock correlations using PostgreSQL and Neo4j graph database