Data Engineer Salary in USA

DESCRIPTIONAre you interested in helping build a world-class transportation network for Amazon as we delight our customers with more 1 day promises and also meet our sustainability targets? Do you want to develop data infrastructure to influence the network design of one of the most complex transportation network in the world? The Data Engineer II in the Network Design Planning & Engineering (NDPE) team within the Global Transportation Services (GTS) organization holds the responsibility for building data engineering solutions that facilitate model developments, to propose designs that reduce cost to serve and improve customer speed.Key job responsibilities- Design and implement data pipelines for the different Network design programs.- Develop foundational data infrastructure for the network design models to enable faster and automated runs of underlying models, with automated end to end data flows. - Identify the business needs for design scenario analysis, formulate data architecture strategies, and develop a user-friendly platform for NDPE program managers to perform what-if analysis. - Define the data engineering processes that leverage various AWS services to improve accessibility, redundancy, data integrity, AWS services costs, and storage requirements.- Develop the high quality solutions for the faster development of the products/models that solve the business needs in a scalable format, while also anticipating future requirements - Collaborate with Research/Applied Scientists, Data Engineers, BIEs, Data Scientists and Product/Program Managers to understand the business and technical requirements, and make decisions that help make the products/programs smoother.- Lead the technical design of the data infrastructure with strong coding skills (preferable in python), code deployment and code maintenance.We are open to hiring candidates to work out of one of the following locations:Arlington, VA, USA | Austin, TX, USA | Bellevue, WA, USA | Nashville, TN, USABASIC QUALIFICATIONS- Bachelor's degree- 2+ years of data engineering experience- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets- Experience with data modeling, warehousing and building ETL pipelines- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions- Experience with SQL- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJSPREFERRED QUALIFICATIONS- Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR- Experience working on and delivering end to end projects independently- If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you’re passionate about this role and want to make an impact on a global scale, please apply!Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $105,700/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. Applicants should apply via our internal or external career site.

Job Title: Data Engineer( Python + AWS)Location : Jersey City LocalSalary:$100K-125KJob responsibilities• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems• Develops secure high-quality production code, and reviews and debugs code written by others• Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems• Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.• Design and develop data pipelines to ingest, store, and process data from multiple sources• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.• Contributes to software engineering communities of practice and events that explore new and emerging technologies• Adds to team culture of diversity, equity, inclusion, and respectRequired qualifications, capabilities, and skills• Formal training or certification on data engineering concepts and 3+ years of applied experience• Practical Experience in one or more programming language(s), such as Python, Java• Experience with SQL-based technologies (e.g., MySQL/ Oracle DB)• Hands-on practical experience delivering data pipelines• Proficient in all aspects of the Software Development Life Cycle• Understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security• Demonstrated proficiency and experience with cloud-native distributed systems• Ability to develop reports, dashboards, and processes to continuously monitor data quality and integrity• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages• Experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis• Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)• Working knowledge of bitbucket and JIRA

 Data EngineerLocation: Arlington, VAHybridElder Research Inc. is a Data Science consulting firm specialized in providing analytic solutions to clients in Commercial and Government industries. Providing analytic solutions to hundreds of companies across numerous industries, our team enjoys a great variety in the type of work they do and exposure to a wide range of techniques and tools. We are trusted advisors to our clients, building lasting relationships and partnering as preferred analytics providers. We use a variety of programming languages and tools to create analytic solutions, often fitting within our clients’ environment and needs.Summary of Position:     As a Data Engineer, you will work directly with clients, managers, and technical staff to understand business needs, develop technical plans, and deliver data-driven analytical solutions and tools that solve client problems. The Data Engineer will primarily create and deploy robust, repeatable, and automated data pipelines that will ingest and transform raw data to support various advanced analytics and machine learning models. The resulting pipeline should be developed to be deployed into existing large-scale applications or different data visualization platforms available. This position will be part of our Government Civilian Team serving Federal Civilian agencies as our primary customers. Essential Functions: Strong troubleshooting and problem-solving capabilitiesDemonstrated experience with various types and sizes of data sets, both quantitative and textWork collaboratively with data scientists, data analysts, and client engagement managers to create and deploy dynamic data applications or data visualization tools that help our customers make meaningful business decisions.  Writing re-usable code in Python, SQL, Java or other languages, and working to refine it through code review and discussion  Develop and deploy robust data pipelines and end-to-end systems in an air-gapped environmentParticipate in every stage of the engineering lifecycle, from ideation and requirements gathering through implementation, testing, deployment, and maintenance Provide leadership and coordination for certain stages of the engineering lifecycle as needed Perform other technical tasks as needed, including writing project reports, managing, implementing, and/or maintaining technical infrastructure, etc. Ability to consider both long-term stability and scalability while taking a user-focused approach to development and deployment. Meetings and discussions with clients and co-workers to refine understanding of the business problem at hand.  Preparing presentations, writing reports (technical and non-technical), and working to communicate technical results to clients with varying levels of analytic sophistication. Ability to work independently in a collaborative, dynamic, cross-functional environment.Demonstrate strong communication and consulting skills, facilitating effective collaboration within a diverse team.Job Specifications/Requirements:Undergraduate and graduate degrees in engineering, computer science, analytics, math, finance, accounting, management information systems, social sciences, physics, or decision science.Design, build, and deploy data engineering pipelines that extracts, transforms raw data into analytics base tables to support downstream machine learning models using languages such as Python, R and SQLDevelop end-to-end ML pipelines, responsible for integration from back to front end in on-premises and cloud environments.Collaborate closely with data scientists, data analysts, client engagement managers, and product managers to understand business requirements and provide solutions.Improve and modernize existing ML pipelines and operations, emphasizing best practices and efficiency gains.Work in a fast-paced environment, contributing to a collaborative and agile development process.Experience engaging and interacting with clients, stakeholders and subject matter experts (SMEs) to understand, gather and document requirements.Comfortable learning new things and working outside of your comfort zone. Communicate clearly both verbally and in writing to teammates and clients. Humble and willing to learn, teach, and share ideas. Travel to and work on-site at clients both local and non-local. Number of days at client site vary depending on project requirements.Must currently possess a Public Trust Clearance Desired SkillsAdvanced degree (MS) in a relevant field (analytics, math, statistics, computer science, management information systems, social sciences, engineering, physics, decision science, or business, etc.,)Experience using version control (e.g. git, svn, Mercurial) and collaborative programming techniques (e.g. pair programming, code reviews)  Experience with containerization and environment management (venv, conda, etc.,)Experience with one or more technologies, such as R Shiny, Databricks, AWS, AzureFamiliarity with vector, object, and document storage databasesExperience implementing data engineering processes in a remote, austere environment to include using bash,Experience with business intelligence and data visualization platforms (Power BI, Tableau, etc.,).Understanding of the data analytics lifecycle (e.g. CRISP-DM).  Elder Research, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.To be considered for this position, you must be eligible to legally obtain a US Public Trust.

Data EngineerBCforward is currently seeking a highly motivated Data Engineer in Columbus, OH area! Our client is one of the oldest financial institutions and offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporations. Their history spans over 200 years and today are the leaders in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management. Job Title: Data Engineer Location: Columbus, OH Duration: 3 months Contract to Hire Hybrid Model: 3 Days onsite 2 days remote Pay Range:$50 - $54 Skills (required): -8+ years of professional experience is the preference Teradata, DBMS knowledge - data warehouse in Teradata - Cloud knowledge - AWS preferably - ETL knowledge - end to end, how process works - CICD and data warehouse concept - check in, check out - - Java & Spark - pipeline set up in these. Skills (Nice to have): - Abinitio - sending the data to public cloud from S3 to Teradata. - postgres DB knowledge - python - in future, java might be replaced with pi spark. Snowflake - might use in future If someone has DB and ETL knowledge they would be highly preferred About BCforward: BCforward began as an IT business solution and staffing firm. Founded in 1998, BCforward has grown with our customers needs into a full-service personnel solutions organization. Headquartered in Indianapolis, Indiana, BCforward also operates numerous delivery centers across North America and India. We are currently the largest consulting firm and largest MBE certified firm in Indiana. Our uninterrupted growth has allowed BCforward to deliver uniquely configured IT staffing and project solutions for over years of catering to our customersspecific needs. BCforward currently maintains a team of over 5000 global resources. With our additional brand, Stafforward, together we have the capabilities to deliver services for a variety of industries in both public and private sectors which allows us to address your most challenging needs. www.BCforward.com www.facebook.com/bcforward This posting is not an offer of employment. All applicants must be authorized to work in the United States and willing cooperate with a background check and drug screen, to the extent permitted by federal and local laws up to, and including, both criminal and financial reviews. The submission of intentionally false or fraudulent information in response to this job posting shall render the applicant ineligible for the position. BCforward is an equal opportunity employer. Any subsequent offer of employment shall be considered employment at will regardless of the anticipated assignment duration.Interested candidates please send resume in Word format Please reference job code 221136 when responding to this ad.Get job alerts by email.Sign up now!Join Our Talent Network!Job SnapshotEmployee TypeContractorLocationColumbus, OH (Onsite)Job TypeBankingExperienceNot SpecifiedDate Posted04/10/2024

Engineer, Senior|6131 218360 - San Diego, CA 921215 Months ContractThe ideal candidate will possess the following qualities.Data engineer to design, process for and build automation for test data analytics and data structure.Engineer is also responsible for injecting domain knowledge into Knowledge Graph (graph database) and supporting execution of an analytic workflow modeled through a Knowledge Graph.Minimum qualifications:• 5 years or more experience with the following languages: Python, Java Script, C#, Shell scripting• 2 years or more experience with databases PostgreSQL: querying (SQL), and data modeling.• 1 year or more experience with graph data models and graph databases• Experience with web development framework especially Rest API and ORM.• Semiconductor knowledge in Product and Test Engineering• Experience in developing data science solution for Hardware Engineering• Bachelor degree in Computer/Electrical Engineering, Math/Stats, Computer Science, or related field.Preferred qualifications:• Experience with Power BI and Excel Dashboard development• Experience with Tibco Data Virtualization• Experience with Statistical Predictive Analytics and Machine Learning models• Experience building automation with Jira, Confluence, SharePoint• Experience with AWS Elastic Beanstalk, Aurora Serverless PostgreSQL + S3 + Glue + Athena + File gateway + IAM + Lambda.• Experience developing Data Warehouse and schema support• Experience with instrument control and data acquisition• Experience with LabVIEW, MATLAB• 5 years or more experience in developing data science solution for Hardware Engineering• Ability to be flexible/adaptable in exercising judgment in a dynamic environment and prioritize and manage tasks efficiently• Excellent communication skills, and the ability to work with stakeholders to provide technical solutions to business challenges• Bachelor and Master degree in Computer/Electrical Engineering, Math/Stats, Computer Science, or related field.

SummaryThe ideal candidate will have a strong background in data engineering, with a focus on healthcare data systems and analytics. As a Healthcare Data Engineer, you will play a key role in designing, building, and maintaining data pipelines, data warehouses, and analytics platforms that support our healthcare software solutions.ResponsibilitiesBachelor's, Master's, or Ph.D. degree in computer science, engineering, statistics, or a related field.Collaborate with cross-functional teams, including data scientists, software developers, and healthcare professionals, to understand data requirements and design scalable and efficient data solutions.Design, develop, and maintain data pipelines and ETL (Extract, Transform, Load) processes to ingest, process, and transform healthcare data from diverse sources, including electronic health records (EHRs), medical imaging data, wearable devices, and claims data.Implement data integration and data modeling solutions to ensure the consistency, accuracy, and integrity of healthcare data across different systems and platforms.Optimize data storage and retrieval mechanisms by designing and implementing data warehouses, data lakes, and data marts that meet the performance and scalability requirements of healthcare analytics applications.Develop and maintain data quality and data governance frameworks to ensure the reliability, completeness, and security of healthcare data throughout its lifecycle.Collaborate with DevOps engineers to automate deployment processes, manage infrastructure as code, and ensure high availability and reliability of data systems and platforms.Implement data security and privacy measures to protect sensitive healthcare information (e.g., PHI) and ensure compliance with regulatory requirements, such as HIPAA and GDPR.Perform data analysis, data profiling, and data visualization to identify trends, patterns, and insights in healthcare data and support data-driven decision-making.Stay current with emerging technologies, trends, and best practices in data engineering, healthcare IT, and healthcare analytics, and apply this knowledge to improve our data solutions.Document data architecture, data flows, and technical specifications, and provide training and support to internal stakeholders on data-related processes and tools.RequirementsStrong proficiency in programming languages and scripting tools used in data engineering (e.g., Python, SQL, Scala).Experience with big data technologies and frameworks, such as Hadoop, Spark, Kaka, and HDFS.Solid understanding of data modeling concepts, relational databases (e.g., PostgreSQL, MySQL), and NoSQL databases (e.g., MongoDB, Cassandra, Melvus and Chroma).Knowledge of data warehousing architectures, data integration techniques, and ETL tools (e.g., Informatica, Talend, Apache NiFi).Familiarity with cloud computing platforms (e.g., AWS, Azure, Google Cloud) and containerization technologies (e.g., Docker, Kubernetes).Understanding of data security, privacy, and compliance requirements in healthcare IT, including HIPAA, GDPR, and HITRUST.Excellent problem-solving skills, analytical thinking, and attention to detail, with the ability to troubleshoot complex data issues and propose effective solutions.Strong communication skills, with the ability to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.Experience with healthcare interoperability standards and protocols, such as HL7 FHIR, DICOM, and CDA.Knowledge of healthcare data exchange formats, including CCD, C-CDA, and Blue Buhon.Previous experience working with healthcare data analytics tools and platforms (e.g., Tableau, Power BI, SAS).Understanding of machine learning and artificial intelligence techniques for healthcare data analysis and predictive modeling.Contributions to open-source projects, participation in technical communities, or attendance at healthcare IT conferences and events.

Data Engineer $120,000 - $140,000Birmingham, AL We're searching for a skilled and collaborative Data Engineer to join our client's growing team! In this role, you'll play a pivotal role in strengthening and expanding their Business Intelligence infrastructure - ensuring they have the data and insights needed to make informed decisions and achieve their company goals.Responsibilities:Data Acquisition & Management (45%)Design and build data gathering systems aligned with client's objectives.Perform core data management tasks, including data cleansing, normalization, and model adjustments.Extract data from various sources, including Dynamics AX & D365, to populate their data warehouse.Data Processing & Analysis (30%)Develop and manage Azure Data Factory pipelines for efficient data processing.Analyze client's business needs and translate data into clear and actionable reports and dashboards for end-users.Problem-solving & Support (25%)Troubleshoot data issues, identify solutions and implement fixes to ensure smooth data flow.Collaborate with the client's Data Architect and Director of IT Integrations to enhance and optimize their BI infrastructure.Qualifications:Education: Bachelor's degree in Computer Science, Information Technology, or a related field with experience in data engineering concepts (or equivalent experience). Master's degree a plus.Experience: 5+ years of experience in data engineering and data warehousing with strong technical skills.Skills & Abilities:Proficiency in SQL, Azure, and data ETL processes.In-depth knowledge of Azure Data Factory and data warehouse optimization techniques.Experience with data modeling tools and scripting languages (Python, etc.) is a plus.Strong problem-solving skills and the ability to thrive in a fast-paced environment.Excellent communication and teamwork skills.Do you have a passion for data and a knack for translating it into actionable insights? If so, we encourage you to apply!PangeaTwo's goal is to ensure that each recruitment opportunity yields rewarding dividends for both candidates and clients. This position requires a US Citizenship or Green Card as the client is not able to provide sponsorship. At our clients' request, only individuals with the required experience will be considered.Please note - if you have recently submitted your resume to a PangeaTwo posting, your qualifications will be considered for other open opportunities. Your resume will never be submitted to a client without your prior knowledge and consent to do so.

10 - 12 years of experience working in large BI, DWH and EDL implementationsShould have strong experience in converting SQL/PL, Data transformations, Data quality and complex SQL's into data lakeExperience using Hadoop Distribution and it's all services for example: YARN, KUDU, OOZIE, IMPALA, HIVE, HBASE, SPARKWorking knowledge of Java / Python & REST APIConducts facilitated working sessions with technical executives and business expertsShould possess excellent communication and presentation skills and be able to explain complete data transformation and model mapping process.Understand of Graph DatabasesWillingness to learn new data lake technologies and hand on implementation.

Data EngineerBCforward is seeking a Data Engineer to work hybrid in Indianapolis, IN Data Engineer Location: Indianapolis, IN Top Skills:-5-10 years Data Integration Experience Experience with cloud systems (azure, synapse, etc)Local candidates highly preferred. The first week will be on-site in the Indianapolis office then 1 time a month for a couple of days. Looking for Intermediate level with 5-10 years of experience. This is a non-business facing position. Work with a small team of experienced data warehousing professionals to apply data engineering and technical skills to assist in the on-going management and development of a mature and broadly used data warehousing/business analytics program. The focus will be on monitoring and supporting current data marts as business requirements, underlying source systems and data mart management procedures change and evolve. This role will also be involved with the innovation effort for migrating processes to Azure Synapse or similar cloud native platforms.Assist team with managing and maintaining the Microsoft Business Intelligence stack data warehousing environment and data marts according to business requirements and data warehousing best practices.Job Responsibilities Apply analytical and problem-solving skills when engaging with business process owners to understand how best to fulfill their business analytics needs. Collaborate among the team and with business process owners and source system developers to keep informed of underlying business requirements and source system changes that should be accommodated in a data mart. Assist with optimizing the architecture and operation of the data warehouse according to refactored data mart development practices. Migrate data marts from on premises hardware to Azure/cloud computing.Other duties as assigned.Bachelor's degree required; Advanced Degree Preferred. Three or more years of experience. Prefer experience including SQL, PL/SQL, .Net/C#, JSON, XML, SQL DBA, Azure/cloud computing, Tableau, SSRS, Excel, SharePoint Data and tech savvy and innovative - strong analytical, problem-solving skills and endless curiosity. Personal development focus - actively seeking new ways to grow and be challenged using both formal and informal development channels including collaborating with experienced teammates. Action oriented - taking on assignments with a sense of urgency, energy and enthusiasm.Key CompetenciesDrives results - consistently achieving results through focus, subject-matter knowledge and determination.Communicates effectively - developing, delivering and participating in communications that is collegial, clear and meets the needs of a variety of audiences.Interested candidates please send resume in Word format Please reference job code 221851 when responding to this ad.Get job alerts by email.Sign up now!Join Our Talent Network!Job SnapshotEmployee TypeContractorLocationIndianapolis, IN (Onsite)Job TypeInformation Technology, Management, Professional ServicesExperienceNot SpecifiedDate Posted04/26/2024

DESCRIPTIONAmazon’s global fulfillment network enables any merchant to ship items that are ordered on Amazon to any place on earth. There is a complex network of ways in which items move between vendor locations, Amazon warehouses, and customer locations as well as several intermediate locations through which packages travel before reaching the customer. With a scale of millions of packages, each with different attributes and delivery requirements, what results is a highly dense graph of nodes.We have built a highly respected software engineering team which is focused on solving complex problems in worldwide transportation using workflows, optimization algorithms, and machine learning systems. These are large-scale distributed systems handling millions of packages being shipped through the Amazon logistics network.You will be working with senior engineers and principals to solve problems of scale, improve existing services & build new ones, and work on deep and complex algorithms to improve the experience of our customers globally while optimizing network operations. We are open to hiring candidates to work out of one of the following locations:Bellevue, WA, USABASIC QUALIFICATIONS- 5+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelines- Experience with SQL- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS- Experience mentoring team members on best practicesPREFERRED QUALIFICATIONS- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR- Experience operating large data warehousesAmazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $123,700/year in our lowest geographic market up to $240,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. Applicants should apply via our internal or external career site.