Pyramid Systems is looking for a Data Engineer (Senior) who is passionate about bringing creative architect solutions to end customers.

• You'll work with AI team members to operationalize data pipelines and ML tasks
• You'll provide day-to-day support of deploying Python-native ML pipelines
• You'll perform data engineering tasks to enable AI/ML capabilities
• You'll present results to a diverse audience in presentation or report form
• You'll support architectural leadership, technical support, and advisement services to ensure identity management system technologies are integrated and meeting the appropriate security requirements
• You’ll support leadership who engage with senior level executives at a public facing Federal agency and provide subject matter expertise in security architecture and other key domain areas

• You have the ability to obtain and maintain DHS Suitability
• You are a US Citizen
• Plan, create, and maintain data architectures, ensuring alignment with business requirements.
• Obtain data, formulate dataset processes, and store optimized data.
• Experiance in Databricks, PySpark and SQL
• Identify problems and inefficiencies and apply solutions.
• Determine tasks where manual participation can be eliminated with automation.
• "Identify and optimize data bottlenecks, leveraging automation where possible
• Create and manage data lifecycle policies (retention, backups/restore, etc.)"
• Create, maintain and manage ETL/ELT pipelines & data transformations
• Create, maintain and manage data quality gates (Great Expectations) to ensure high data quality
• Support the AI/ML teams with optimizing feature engineering code
• Lots and lots of Spark updates
• Create, maintain and manage Spark Structured Streaming jobs, including using the newer Delta Live Tables and/or DBT
• Research existing data in the data lake to determine best sources for data
• Create, manage and maintain ksqlDB and Kafka Streams queries/code
• Maintain and update Python-based data processing scripts executed on AW Lambdas
• Unit tests for all our Spark, Python data processing, and Lambda codes
• Maintain our PCIS Reporting Database data lake with optimizations and maintenance (perf tuning, etc.)

Education 

• Bachelor's degree in Computer Science or related discipline

The below listed pay range for this position is not a guarantee of compensation or salary. The final offered salary will be influenced by a host of factors including, but not limited to, geographic location, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, education, and certifications. Our employees value the flexibility at Pyramid Systems that allows them to balance quality work and their personal lives. We offer competitive compensation, benefits, to include our Employee Stock Ownership Program, FlexPTO, and learning and development opportunities.

USD $103,020.00/Yr.

USD $154,530.00/Yr.

Pyramid Systems, Inc. is an award-winning, technology leader, driving digital transformation across federal agencies. We empower forward-thinking innovations, accelerate production-ready software, and deliver secure solutions so federal agencies can meet their mission goals. Voted a Top Workplace, both regionally (Washington, DC) and Nationally (USA) the past 2 years (2023 and 2024) based on the feedback from our employees, we are headquartered in Fairfax, VA. and have a growing national footprint. We value and promote our Flexible Workplace approach because of the positive impacts it has on work-life integration. We remain committed to ensuring every employee’s voice is heard, performance and results are recognized and rewarded, development and advancement is a focus, and diversity, equity and inclusion is a company priority. We offer competitive compensation and benefits (including a recently launched Employee Stock Ownership Plan - ESOP), a robust performance-based rewards program, and we know how to have fun! Our people and culture have endured and delivered for our clients for nearly three decades.

Pyramid Systems, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.