Pyramid Systems is looking for a Data Engineer (Senior) who is passionate about bringing creative architect solutions to end customers.
Responsibilities
You'll work with AI team members to operationalize data pipelines and ML tasks
You'll provide day-to-day support of deploying Python-native ML pipelines
You'll perform data engineering tasks to enable AI/ML capabilities
You'll present results to a diverse audience in presentation or report form
You'll support architectural leadership, technical support, and advisement services to ensure identity management system technologies are integrated and meeting the appropriate security requirements
You’ll support leadership who engage with senior level executives at a public facing Federal agency and provide subject matter expertise in security architecture and other key domain areas
Qualifications
You have the ability to obtain and maintain DHS Suitability
You are a US Citizen
Plan, create, and maintain data architectures, ensuring alignment with business requirements.
Obtain data, formulate dataset processes, and store optimized data.
Experiance in Databricks, PySpark and SQL
Identify problems and inefficiencies and apply solutions.
Determine tasks where manual participation can be eliminated with automation.
"Identify and optimize data bottlenecks, leveraging automation where possible
Create and manage data lifecycle policies (retention, backups/restore, etc.)"
Create, maintain and manage ETL/ELT pipelines & data transformations
Create, maintain and manage data quality gates (Great Expectations) to ensure high data quality
Support the AI/ML teams with optimizing feature engineering code
Lots and lots of Spark updates
Create, maintain and manage Spark Structured Streaming jobs, including using the newer Delta Live Tables and/or DBT
Research existing data in the data lake to determine best sources for data
Create, manage and maintain ksqlDB and Kafka Streams queries/code
Maintain and update Python-based data processing scripts executed on AW Lambdas
Unit tests for all our Spark, Python data processing, and Lambda codes
Maintain our PCIS Reporting Database data lake with optimizations and maintenance (perf tuning, etc.)
Education
Bachelor's degree in Computer Science or related discipline
Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed
Why Pyramid?
Pyramid Systems, Inc. is an award-winning, technology leader, driving digital transformation across federal agencies. We empower forward-thinking innovations, accelerate production-ready software, and deliver secure solutions so federal agencies can meet their mission goals. Voted a Top Workplace, both regionally (Washington, DC) and Nationally (USA) the past 2 years (2023 and 2024) based on the feedback from our employees, we are headquartered in Fairfax, VA. and have a growing national footprint. We value and promote our Flexible Workplace approach because of the positive impacts it has on work-life integration. We remain committed to ensuring every employee voice is heard, performance and results are recognized and rewarded, development and advancement is a focus, and diversity, equity and inclusion is a company priority. Our people and its culture have endured and delivered for its clients for nearly three decades.
We offer competitive compensation and benefits (including a recently launched Employee Stock Option Plan - ESOP), a robust performance-based rewards program, and we know how to have fun!
Company EEO Statement
Pyramid Systems, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.