Senior Data Engineer (MUST HAVE A U.S. FEDERALLY AUTHORIZED TOP SECRET SECURITY CLEARANCE)
Apply on
Availability Status
This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.
Soft Tech Consulting is seeking a highly motivated, self-directed individual to fill the role of a Senior Data Engineer. The selected individual will join a collaborative team environment where they will provide support toward the successful delivery of the project deliverables. Key to the success of this position is the effective communication to all levels of staff for reporting project status.
MUST HAVE A U.S. FEDERALLY AUTHORIZED TOP SECRET SECURITY CLEARANCE
THE PRIMARY PLACE OF PERFORMANCE WILL BE AT NCR (WASHINGTON, DC) OR HUNTSVILLE, AL
RESPONSIBILITIES
- Validate data that is extracted from structured and unstructured data sources, databases, and other repositories, using scripts and other automated capabilities to load data, logs, and queries.
- Validate successful implementation of documented requirements by designing, developing, delivering, performing, and sustaining manual and automated tests (utilizing tools such as Selenium and Junit) that verify the implementation of the system and its components (including APIs, microservices, UI, etc.), monitor the operational capability of the system and its components, and gather metrics that reflect upon the performance of the system and its components.
- Design, develop, deliver, and sustain new and existing data analysis and forecasting solutions using data structures large and small that scale to use with large data volumes
- Support various data management (purging, clean-up, updates, etc.) tasks, utilizing Structured Query Language (SQL)
- Use expertise in data modeling and SQL to administer, maintain, and improve database systems and ETL data pipelines to support Big Data analytics systems.
- Utilize common development languages such as Java, JavaScript, Python, and .NET
- Support efforts to create data definition, data model, data manipulation, and data control scripts in support of large-scale data exports
- Support in managing existing APIs and Application Services (AS) while identifying ways to automate existing and new processes
- Support the sustainment of exisng and delivery of new automated Extract, Transform and Load (ETL) pipelines, using a suite of COTS, GOTS, Java, and other tools
- Develop code that does not unnecessarily add new technical debt to a release and correct any defects identified by testers, code reviewers, automated tools, or as part of the Continuous Integration/Continuous Delivery (CI/CD) activities
QUALIFICATIONS
- Bachelor's Degree
- Minimum 8 years of related experience
REQUIREMENTS:
- Experience in Entity Resolution, developing and implementing methods to identify and link records across different data sources that represent the same real-world entity (e.g., person, organization, product)
- Experience with Natural Language Processing (NLP) models for tasks like text classification, sentiment analysis, and entity recognition
- Experience with Natural Language Generation (NLG) models for tasks like text summarization
- Experience with Databricks and Spark, PyTorch, Tensorflow, Python, Scala, CoreNLP, and Transformer foundational models
OR
- Experience with Software development and maintenance of internal/external interfaces with systems that provide data (IC Data Services, OGA Systems on the Unclassified side, Internal client Systems, etc.)
OR
- Experience with HTML, Vue Framework, Javascript, Java and .NET
- Experience with Apache Solr
OR
- Experience with .NET, C#, Javascript, Java, Perl
- Experience with Oracle, API Architecture (SOAP/REST), Git
- Experience with Solr, Bash Shell
- Experience with Oracle Label Security, PL/SQL
- Experience with Visual Studio Pro, Selenium
OR
- Databricks and Lakehouse architectures
- AWS OpenSearch
- Experience with AWS, Splunk and other Oracle/SQL based platforms.
- Experience with python, Microsoft VBA
ABOUT US
Soft Tech Consulting, Inc. is a woman and minority-owned business headquartered in Chantilly, VA. With contracts in both the public and private sectors in the DC metro area and across the country, Soft Tech is an organization made up of highly successful and talented Information Technology professionals offering enterprise class solutions for any size organization at great value. Soft Tech s mission is to help government organizations design, implement, and maintain mission critical Information Technology solutions. By focusing jointly on our employees and our customers, we are able to achieve our mission by providing each and every one of our customers with continuous quality customer support. Soft Tech Consulting, Inc. is an Equal Opportunity Employer.