Search Jobs
PDS Inc, LLC
http://www.pdsinc.com
http://www.pdsinc.com
true
Data Engineer
Posted: 08/29/2024
2024-08-29
2025-01-10
Employment Type:
Contract
Job Category: Data Engineering
Job Number: 23948
Workplace Type: Remote
Job Description
Data Engineer
Compensation: DOE
The Data Engineer is a hands-on technical role focused on full stack software development within the Enterprise Data organization. The role will pay curtail part in shaping future big data and analytics initiatives.
PRINCIPAL RESPONSIBILITIES:
• Designs and develops code and data pipelines to ingest from relational databases (Oracle, SQL Server, DB2, Aurora), file shares, and web services.
• Build Data Lake on AWS S3 with optimal performance considerations by partitioning and compressing data.
• Data Engineering and Analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python.
• Data modeling and building Data Warehouse using Snowflake.
• Designs and develops code and data pipelines to ingest relational databases, file shares, and web services.
• Participates in requirements definition, system architecture design, and data architecture design.
• Participates in all aspects of the software life cycle using Agile development methodologies.
MINIMUM QUALIFICATIONS:
• Bachelor’s degree in computer science, Computer Information Systems, Engineering, Statistics or closely related field (willing to accept foreign education equivalent) (required).
• Experience in AWS services for data and analytics (required).
• 5 years of experience in Data Ingestion, Data Extraction, and Data Integration (required).
PREFERRED QUALIFICATIONS:
• 7+ years of experience in Enterprise Information Solution Architecture, Design, and development required.
• 7+ years of experience with integration architectures such as SOA, Microservices, ETL or other integration technologies.
• 7+ years of experience with working content or knowledge management systems, search engines, relational databases, NoSQL databases, ETL tools, geospatial systems, or semantic technology.
• 5+ years of hands-on experience with AWS services ( S3, Kinesis, Lambda, Athena, Glue, EMR) required.
• 5+ years’ experience on Snowflake, DBT and Denodo.
• Experience with JSON or XML data modeling required.
• Experience with Git/GitHub, branching, and other modern source code management methodologies required.
• Domain knowledge of NoSQL or relational database required.
• Understanding of database architecture and performance implications required.
• Experience integrating Business Intelligence applications like PowerBI.
• Experience with Machine Learning and Artificial Intelligence.
• Ability to multi-task effectively.
• Ability to work collaboratively as part of an Agile Team.
• Extensive knowledge and experience with Python, JavaScript and Java.
• Excellent written and verbal communication skills, sense of ownership, urgency and drive.
We look forward to reviewing your application. We encourage everyone to apply - even if every box isn’t checked for what you are looking for or what is required.
PDSINC, LLC is an Equal Opportunity Employer.
Compensation: DOE
The Data Engineer is a hands-on technical role focused on full stack software development within the Enterprise Data organization. The role will pay curtail part in shaping future big data and analytics initiatives.
PRINCIPAL RESPONSIBILITIES:
• Designs and develops code and data pipelines to ingest from relational databases (Oracle, SQL Server, DB2, Aurora), file shares, and web services.
• Build Data Lake on AWS S3 with optimal performance considerations by partitioning and compressing data.
• Data Engineering and Analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python.
• Data modeling and building Data Warehouse using Snowflake.
• Designs and develops code and data pipelines to ingest relational databases, file shares, and web services.
• Participates in requirements definition, system architecture design, and data architecture design.
• Participates in all aspects of the software life cycle using Agile development methodologies.
MINIMUM QUALIFICATIONS:
• Bachelor’s degree in computer science, Computer Information Systems, Engineering, Statistics or closely related field (willing to accept foreign education equivalent) (required).
• Experience in AWS services for data and analytics (required).
• 5 years of experience in Data Ingestion, Data Extraction, and Data Integration (required).
PREFERRED QUALIFICATIONS:
• 7+ years of experience in Enterprise Information Solution Architecture, Design, and development required.
• 7+ years of experience with integration architectures such as SOA, Microservices, ETL or other integration technologies.
• 7+ years of experience with working content or knowledge management systems, search engines, relational databases, NoSQL databases, ETL tools, geospatial systems, or semantic technology.
• 5+ years of hands-on experience with AWS services ( S3, Kinesis, Lambda, Athena, Glue, EMR) required.
• 5+ years’ experience on Snowflake, DBT and Denodo.
• Experience with JSON or XML data modeling required.
• Experience with Git/GitHub, branching, and other modern source code management methodologies required.
• Domain knowledge of NoSQL or relational database required.
• Understanding of database architecture and performance implications required.
• Experience integrating Business Intelligence applications like PowerBI.
• Experience with Machine Learning and Artificial Intelligence.
• Ability to multi-task effectively.
• Ability to work collaboratively as part of an Agile Team.
• Extensive knowledge and experience with Python, JavaScript and Java.
• Excellent written and verbal communication skills, sense of ownership, urgency and drive.
We look forward to reviewing your application. We encourage everyone to apply - even if every box isn’t checked for what you are looking for or what is required.
PDSINC, LLC is an Equal Opportunity Employer.
Share This Job:
Related Jobs:
Login to save this search and get notified of similar positions.About Phoenix, AZ
Ready to elevate your career in the vibrant Phoenix, Arizona area? Explore our diverse job opportunities in this dynamic region known for its sunny skies, breathtaking desert landscapes, and thriving job market. Known as the Valley of the Sun, Phoenix boasts a unique mix of Southwestern charm and urban sophistication. Discover the bustling arts scene at the Phoenix Art Museum, catch a performance at the iconic Orpheum Theatre, or cheer on the Arizona Diamondbacks at Chase Field. With an array of outdoor activities in stunning parks like Camelback Mountain and Papago Park, plus delectable Southwestern cuisine to savor, there's no shortage of reasons to make Phoenix your professional playground. Browse our job listings today and unlock a world of career possibilities in this exciting region!
