Sr. Data Engineer
Crane Worldwide Logistics · Houston, Texas, US
Essential Job Functions - Design and build data pipelines and platform features that work at scale - Own projects end-to-end, from scoping through production...
Job description
Essential Job Functions: - Design and build data pipelines and platform features that work at scale - Own projects end-to-end, from scoping through production deployment - Contribute to architecture decisions and participate in design reviews - Support production systems through on-call rotations and incident response - Improve monitoring, alerts, and runbooks to keep things reliable - Collaborate across teams and share knowledge through code reviews, pairing, and documentation Other Skills & Abilities: - Data warehouses: Snowflake, BigQuery, Redshift - Observability: Prometheus, Grafana, Datadog, PagerDuty - Data quality/governance tooling - Schema management: Schema Registry, Protobuf, Avro - Data cataloging: Datahub, Amundsen Education & Experience: - Bachelor’s degree required in a related analytical field. - Freight Forwarding background - minimum 7 years Business - Analysis experience - Languages: Python, F# or any other language; SQL; shell scripting - Streaming: Kafka, Redpanda, Kinesis - Batch: dbt, Spark, Airflow Cloud: AWS, GCP, or Azure - Databases: PostgreSQL, MySQL; familiarity with data lakes and columnar formats (Parquet, ORC) - Infrastructure: Kubernetes, Docker, T...