Muhammad Omar Farooq
Data Engineer
I build production ELT on Snowflake, dbt, and Airflow — where reliability beats demos. I open-source the hard parts: data contracts, governed query gateways, and developer tooling.
Flagship project
// what I'm buildingTrustline
An open-source trust layer for data products. Trustline compiles human-writable YAML contracts into SQL checks and produces a measurable integrity scorecard across ETL, ML, and delivery seams — because business systems fail at the boundaries.
$ pip install trustline $ trustline audit --demo
Deckflow
Spaced repetition for engineers who learn in git. Git-native deck projects, FSRS scheduling, rich review telemetry. Python, FastAPI, React.
Flowpact
Human-writable workflow + success contracts for AI products. A CLI that derives client ask-lists and no-claim gates from one pact.yaml.
Agent Dynamite
A governed SQL query gateway with policy enforcement, result caps, and audit logging over DuckDB and Postgres — the safe path for agents to touch data.
Fintech Lakehouse
Synthetic fintech ELT: Airflow orchestration, partitioned Parquet lake, DuckDB + dbt marts for payments, settlements, and fraud.
Open source & community
// contributing upstreamI contribute to dbt-core from real production pain — not drive-by typos. Open pull requests span:
catalog generation · fail-fast test validation · incremental backfill semantics
What I do
// core focus- Incremental ingestion — idempotent pipelines, cursor pagination, dedup-safe merges, timestamp-resume on failure
- Data modeling — dimensional models, SCD Type-2 history, marts for BI and product analytics
- Orchestration & CI/CD — Airflow on Amazon MWAA, Git-based deploys for data pipelines
- Reliability — data quality & freshness frameworks, dbt tests, validation rules
- Observability — failure detection via Snowflake procedures with Slack alerting
- Data contracts — treat contracts like APIs: versioned, testable, reviewable
Experience
// track recordSoftware Engineer — Devsinc
Own Snowflake + dbt ELT across 5+ production systems, including a bidirectional HubSpot ↔ Snowflake sync over 4M+ contacts. Built observability/alerting and CI/CD on MWAA. Promoted from Associate Engineer.
Associate Software Engineer — Devsinc
Built ETL/ELT pipelines with Airflow, Airbyte, dbt, SQL, and Python. Designed dimensional models with SCD Type-2 tracking and automated data validation frameworks.
AI Research Engineer — GrowthRune
Built LLM retrieval systems (LlamaIndex, MongoDB Atlas, vector search, GPT-4) and multi-agent workflow automation with CrewAI.
B.Sc. Computer Engineering — UET Taxila
Bachelor's in Computer Engineering.