About this role
Sr. Data Engineer at Pyramid Systems, Inc.. Location: Fairfax, Virginia, United States. Role: Plan data architectures, Maintain data pipelines, Monitor data pipelines Requirements: 8+ years IT data architecture, public trust clearance, US citizen, Bachelor's degree; Expertise in Databricks, Delta Lake, Delta Live Tables; Spark; ETL/ELT tools; advanced SQL; data pipelines; AWS; CI/CD; Kafka; Python. Category: Data and Analytics Seniority: Senior Level Tools: Databricks, Structured Streaming, Delta Lake, Delta Live Tables, Spark, Spark SQL, Spark DataFrames, PySpark, SSIS, Pentaho, Data Migration Service, Python, Pytest, Unittest, JSON, Kafka, Confluent, Schema Registry, ksqldb, Kafka Streams, Airflow, Jenkins, Docker, CloudWatch, AWS, DynamoDB, S3, Kinesis, DBT, Great Expectations Certifications: public trust Commitment: Full Time Workplace: Onsite Languages: English