We use cookies to improve the user experience, analyze traffic and display relevant ads.
Details Accept
Enter position

Data Engineer Salary in New York, NY

Receive statistics information by mail
Unfortunately, there are no statistics for this request. Try changing your position or region.

Найдите подходящую статистику

Architectural Engineer

Смотреть статистику

Assistant Engineer

Смотреть статистику

Automation Engineer

Смотреть статистику

Automotive Engineer

Смотреть статистику

Build Engineer

Смотреть статистику

Car Detailer

Смотреть статистику

Chemical Engineer

Смотреть статистику

Chief Engineer

Смотреть статистику

Completion Engineer

Смотреть статистику

Component Engineer

Смотреть статистику

Customer Engineer

Смотреть статистику

Desktop Engineer

Смотреть статистику

Development Engineer

Смотреть статистику

Electric Control Engineer

Смотреть статистику

Electronic Engineer

Смотреть статистику

Engineer

Смотреть статистику

Engineering Intern

Смотреть статистику

Engineering Project Manager

Смотреть статистику

Engineering Supervisor

Смотреть статистику

Engineering Technician

Смотреть статистику

Equipment Engineer

Смотреть статистику

Facility Engineer

Смотреть статистику

Field Engineer

Смотреть статистику

Field Service Engineer

Смотреть статистику

Firmware Engineer

Смотреть статистику

General Engineer

Смотреть статистику

Geotechnical Engineer

Смотреть статистику

Hardware Engineer

Смотреть статистику

Implementation Engineer

Смотреть статистику

Industrial Engineer

Смотреть статистику

Infrastructure Engineer

Смотреть статистику

Instrument Engineer

Смотреть статистику

Instrumentation Engineer

Смотреть статистику

Interface Engineer

Смотреть статистику

Materials Engineer

Смотреть статистику

Mechanical Engineer

Смотреть статистику

Office Engineer

Смотреть статистику

Optical Engineer

Смотреть статистику

Package Engineer

Смотреть статистику

Packaging Engineer

Смотреть статистику

Plant Engineer

Смотреть статистику

Platform Engineer

Смотреть статистику

Principal Engineer

Смотреть статистику

Program Engineer

Смотреть статистику

Project Management Engineer

Смотреть статистику

Reliability Engineer

Смотреть статистику

Reservoir Engineer

Смотреть статистику

Reverse Engineer

Смотреть статистику

Search Engineer

Смотреть статистику

Server Engineer

Смотреть статистику

Services Engineer

Смотреть статистику

Site Engineer

Смотреть статистику

Solution Engineer

Смотреть статистику

Sound Engineer

Смотреть статистику

Storage Engineer

Смотреть статистику

Sustaining Engineer

Смотреть статистику

Technical Engineer

Смотреть статистику

Technology Engineer

Смотреть статистику

Test Engineer

Смотреть статистику

Tools Engineer

Смотреть статистику

Traffic Engineer

Смотреть статистику

Transport Engineer

Смотреть статистику

Transportation Engineer

Смотреть статистику

Utilities Engineer

Смотреть статистику

Validation Engineer

Смотреть статистику

Voice Engineer

Смотреть статистику

Web Engineer

Смотреть статистику
Show more

Recommended vacancies

Data Engineer, Amazon Shopping Videos
Amazon, New York, NY, US
DESCRIPTIONIt’s an exciting time to be on the Amazon Shopping Videos team. We have millions of videos that help customers shop every day. These include product demos, customer reviews, buying guides, and how-to guides. How do we choose the right videos to show, to the right customer, at the right time, helping them make the right shopping decision? That’s where you come in.Data is at the center of every product we develop as we create new features and products that serve the needs of our growing base of consumers and brands. As a Data Engineer on the Amazon Video Shopping team, you will lead the design and implementation of systems capable of processing, storing and querying large datasets. You will partner with product managers and engineers to help build and support data needs of partner teams, reporting solutions, machine learning systems and analytics. About the teamNow more than ever, customers watch videos when they shop. Videos and livestreams make shopping easier and more fun, whether a customer is researching a product or tuning in to chat with their favorite content creator live. The Amazon Shopping Video (ASV) team’s mission is to enable customers to find inspiration, information, entertainment, and community through videos at any point in their shopping journey. If you are interested in building an entertainment product, enjoy a creative and fast-paced working environment, and want to work on a strategic new initiative, join our team today!We are open to hiring candidates to work out of one of the following locations:New York, NY, USA | Seattle, WA, USABASIC QUALIFICATIONS- 3+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelines- Experience with SQLPREFERRED QUALIFICATIONS- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $105,700/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. Applicants should apply via our internal or external career site.
Data Engineer, Amazon Ads, ML Service
Amazon, New York, NY, US
DESCRIPTIONAd Catalyst is part of Advertiser Experience organization within Amazon Worldwide Advertising. Amazon Advertising is one of Amazon's fastest growing and most profitable businesses. The Advertiser Experience (AX) organization owns the experience of the advertiser from the moment they decide to engage with our platform through the full lifecycle of self-service advertising management. Ad Catalyst Team enables Advertisers to get most growth by providing them with science-backed ML generated guidance at-scale by connecting retail, advertising and marketing signals. We are looking for an experienced data engineer with a track record of delivering high quality big data pipelines using AWS distributed architectures (e.g., Glue, S3, Spark, EMR, Airflow) and is a great team player who is skilled in stakeholder management. You will be working closely with cross-functional teams (science and SDE) to build robust data pipelines, optimize data processing systems, and deploy machine learning models that power our advertiser facing solutions. This role offers a unique opportunity to contribute to the intersection of data engineering and machine learning in a dynamic and collaborative environment. Your contributions will directly lead to enhanced site wide performance, growth in ad products, innovative new experiences, faster execution for engineering teams, and increased success of Amazon’s fastest growing business. Strong candidates for this role will have strong problem-solving skills with a keen attention to detail in designing and optimizing data processing pipelines, ability to collaborate effectively with cross-functional teams, excellent communication skills, with the ability to articulate complex technical concepts to both technical and non-technical stakeholders. If you enjoy working and growing high performance teams, being part of a rapidly growing business, and inventing creative solutions to complex problems, this role is for you! We are open to hiring candidates to work out of one of the following locations:New York, NY, USAKey job responsibilities* Design and implement scalable data pipelines for collecting, processing, and storing large volumes of data* Collaborate with data scientists, software engineers, and domain experts to evaluate, gather and process data for model training* Work closely with scientists to integrate machine learning models into production pipelines* Develop and implement data quality and validation processes to ensure accuracy and reliability* Optimize and fine-tune models for performance, scalability, and efficiency.* Work closely with SDE teams to design data solution for API use* Bar raising the operational excellence of data engineer practiceWe are open to hiring candidates to work out of one of the following locations:New York, NY, USABASIC QUALIFICATIONS- 5+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelines- Experience with SQL- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets- Proven experience to contribute to the development of operational processes for efficient data model deployment and maintenancePREFERRED QUALIFICATIONS- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)- Experience providing technical leadership and mentoring other engineers for best practices on data engineering- Experience in popular machine learning frameworks such as TensorFlow, PyTorch, or scikit-learnAmazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $105,700/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. Applicants should apply via our internal or external career site.
Data Engineer, Forecasting Core Data Engineering
Amazon, New York, NY, US
DESCRIPTIONAmazon Forecasting team is looking for a Data Engineer to join the team. We are pioneers in the fields of Amazon demand analysis and forecasting. Forecasting data engineers build scalable data transformation pipelines to ingest data from different data sources, and provides big data sources for machine learning models to predict the Amazon demand world wide. If you want to learn how to leverage technology to predict the future, this is the team for you.As a member of the Demand Forecasting team, you'll play a key role in solving one of the world's most complex technical challenges in data engineering. You will utilize large-scale compute platform to build big datasets used in distributed systems for machine learning and statistical analysis - just to name a few.Our Data Engineer needs to be able to gather and understand data requirements, build and maintain big data sources to prepare data for machine learning models, data scientists, business intelligent engineers, and work with software engineers to achieve high quality data ingestion and transformation solutions. You need a passion for solving complex problems, and enjoy the challenge of operating complex systems under extreme loads. If you think you’re up to the challenge and you’d like to learn more, we’d love to talk to you. In this role, you will be a technical expert with significant scope and impact. You will work closely with a group of software development engineers, product managers, data scientists, and business intelligence engineers to create the data infrastructure and data processing pipelines to drive our team’s initiatives.Successful candidates should come from a strong data engineering background. You need to have experience with structured data, and being able to analyze/transform the data using various tools. Although SQL is a strong requirement, being flexible enough to work with scripting language is a must. Often, the pace of innovation and change implies a need to move to new data sources, and our data engineers get to participate in deep diving business data in order to understand/measure sources of disparity. Your analytical skills and knowledge of schema, metadata and data structure in big data world will be essential.As a data engineer, you will need to design and develop high scalable ETLs with EMR based applications as well supporting them on Glue ETL or Redshift. Knowledge of big data architecture and design is a must. Key job responsibilities- Create scalable data solutions using AWS and/or Amazon internal tools. - Create and maintain business logic for data transformation and ingestion pipelines. - Create and maintain datasets in Amazon data lake and internal data management systems using S3/Glue.- Data investigation and analysis to understand the impact of changes on downstream customers' use cases and build transformation logic to ingest data for Forecasting data analysis.- Provide quality data for Amazon downs team data consumers.A day in the lifeWe not only provide data to machine learning models but also to our direct customers in BI and Data Science. We help them to get access to the data which they need for data analysis, working with them to address data quality issues and resolve data requirements for experiments, training and back testing models as well as data required for generating the forecast on regular basis. We are open to hiring candidates to work out of one of the following locations:New York, NY, USABASIC QUALIFICATIONS- 2+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelines- Bachelor's degree, or Master's degree- Experience with SQLPREFERRED QUALIFICATIONS- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)- 3+ years of data engineering experience- If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you’re passionate about this role and want to make an impact on a global scale, please apply!Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $105,700/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. Applicants should apply via our internal or external career site.
Data Engineer II, GDT DASH
Amazon, New York, NY, US
DESCRIPTIONAre you interested in being a part of Amazon’s fastest growing business? Are you excited to work on cutting edge Big Data technologies to help shape the future of Grocery data? If the answer to both these questions is Yes, then come be a part of Amazon Fresh’s Central Data Infrastructure team (DASH). Our vision is to build a world class, centralized and secure data infrastructure for Amazon’s Worldwide Omnichannel Grocery Business. Our mission is to make it extremely convenient for Internal stakeholders, 3P partners and the Grocery engineering community to access timely and accurate data for all their reporting and analytics needs. The scale and the complexity of the data we manage requires constant innovation and pushing the boundaries on what’s possible. This role offers you an opportunity to work on VP level visibility initiatives and make a lasting impression on how grocery data is managed and distributed across the globe.Key job responsibilitiesIn this role you will: - Help build the infrastructure to answer questions with data, using software engineering best practices, data management fundamentals, data storage principles, and recent advances in distributed systems - Manage AWS resources. - Collaborate with Business Intelligence Engineers to recognize and help adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation - Collaborate with Data Scientists to implement advanced analytics algorithms that exploit our rich data sets for statistical analysis, prediction, clustering and machine learning - Drive the architecture and technology choices that enable a world-class user experience - Develop expertise in a broad range of Amazon’s data resources and know when, how, and which to use and which not to use - Encourage the organization to adopt next-generation data architecture strategies, proposing both data flows and storage solutions - be comfortable with a degree of ambiguity and willing to develop quick proof of concepts, iterate and improve - Create extensible designs and easy to maintain solutions with the long term vision in mind - Have an understanding and empathy for business objectives, and continually align your work with those objectives and seek to deliver business value. You listen effectively.A day in the lifeSuccessful candidate would have extensive experience working with big data, building data warehouses and data processing services. They are effective at seeing data patterns and building generic data solutions to improve user experience. Proficiency in SQL and data modelling allows to create data warehouses and tables conforming to wide range of business needs. Previous ETL and MPP experience enables candidate to build extensible and scalable pipelines capable of processing large amounts of data in a short time, ex. >1T rows within few hours. Wide industry experience helps detect inefficiencies in existing designs and address them with minimal effort.About the teamGDT DASH is Amazon Fresh central data team responsible for the creation and maintenance of Amazon Grocery’s global data infrastructure. Our mission is to make all of grocery data easily accessible across multiple businesses by all users from a single location without any restrictions for all their reporting and analytics needs. Our long-term vision is to build a best-in-class data infrastructure to support worldwide grocery data to enable timely reporting and automated decision-making with standardized metrics to deliver top-line and bottom-line impact to Amazon’s grocery business.We are open to hiring candidates to work out of one of the following locations:Austin, TX, USA | New York, NY, USA | San Diego, CA, USA | Seattle, WA, USABASIC QUALIFICATIONS- 3+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelinesPREFERRED QUALIFICATIONS- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $105,700/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. Applicants should apply via our internal or external career site.
Data Engineer (Tableau)
The Judge Group Inc., New York
Location: REMOTESalary: $100,000.00 USD Annually - $120,000.00 USD AnnuallyDescription: Our client is currently seeking a Data Engineer (Tableau)The Data Engineer you will be responsible for driving and navigating the analytics product life cycle. The ideal candidate will lead in expanding our analytics products while optimizing our data architecture, and developing best practices and governance for administrative reporting, data visualization, and data flow for cross-functional teams.You will support various stakeholders and ensure consistent optimal product delivery throughout ongoing projects. You will also support non-technical colleagues in collecting and appropriately using administrative data. We would like an individual that is excited about re-designing CHOP's data architecture to support our next generation of products and data initiatives.If interested in applying or more information email [email protected] This job will have the following responsibilities:Conduct data modeling by evaluating structured and unstructured data and determining the most appropriate schema for new fact tables, data marts, etc. Collaborate with teams across the enterprise to scope requests, extract data from various data sources, validate results, create relevant data visualizations, and share with the requester in Tableau. Create dashboards and automate refreshes as appropriate in Tableau Server. Adhere to and contribute to data governance standards and educate and support colleagues in best practices to ensure that data is used appropriately. Collaborate and act as the voice of the customer to offer concrete feedback and project requests as well as an advocate for analytics from within the business units themselves. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements, such as automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability.Construct the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources (including ground, hybrid cloud, and cloud) using SQL and various programming technologies. Develop analytics tools that utilize data resources to provide actionable insights, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Administrative, and Analyst teams to assist with data-related technical issues and support their data infrastructure needs. Qualifications & Requirements: 5 years of experience in Data Engineering, Business Intelligence, or Data Warehousing Healthcare consulting experience is a plusBachelor's degree in computer/Analytics/Data Science related field. Proficiency in appropriate Business Intelligence/Data Warehousing technology or subject domain. 3-6 years of Business Intelligence/Data Warehousing experience, preferably in a healthcare & research environment. Preferred Qualifications: Tableau certification and a strong portfolio on Tableau Public Experience with other data visualization tools like Power BI, QlikView, or Domo Knowledge of ETL processes and tools such as Informatica or Talend Contact: [email protected] job and many more are available through The Judge Group. Find us on the web at www.judge.com
Data Engineer
NPA Worldwide, New York
Our client, is a leading quantitative investment company focused on computer-driven trading in global financial markets. We are a team of researchers, engineers, and financial industry professionals using sophisticated statistical models to analyze data and identify predictive signals to generate superior investment returns. Our investment teams each focus on their independent strategies while utilizing the firm's proprietary, state-of-the-art technology and data platform to optimize their alpha research.They have an opening for a Data Engineer.In this role you will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. You should be experienced in building data pipelines and building data systems from the ground up. This individual will support our quantitative developers, data modelers, architects, and data owners across various data initiatives, and ensure an optimal and consistent data delivery architecture. You should be self-directed and comfortable supporting the data needs of multiple teams, and be prepared to be onsite 4 days a week. This is a DIRECT-HIRE FTE role. No consultants, C2C or ContractorsRoles • Design, construct, test and maintain data architectures and data pipelines.• Ensure our data architecture supports the requirements of the business.• Develop custom data models and algorithms to apply to data sets.• Assess the effectiveness and accuracy of new data sources and data gathering techniques.• Discover opportunities for data acquisition.• Develop data set processes for data modeling, mining, and production.• Employ a variety of languages and tools to marry systems together.• Recommend ways to improve data reliability, efficiency, and quality.• Leverage large volumes of data from internal and external sources to answer business demands.• Introduce automation through effective metadata management and using innovative and modern tools and techniques. Partially or completely automate the most common and repeatable data preparation and integration tasks.• Propose appropriate data ingestion, preparation, integration, and operationalization techniques in addressing data requirements.• Lead the development of data governance policies and best practices for consumers and users of data we provision.• Coordinate with different functional teams to implement models and monitor outcomes; and develop processes and tools to monitor and analyze model performance and data accuracy.Skills:• Expert skills in the use of Python.• Significant experience in the development of new automation of data feeds and pipelines• Experience in supporting all kinds of data sets in various formats, structured or unstructured.• Knowledge and/or certifications on upcoming NoSQL/Hadoop-oriented databases like MongoDB, Cassandra, and others for non-relational databases.• Experienced working with large, heterogeneous data sets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional data integration technologies;• Experienced working with popular data discovery, analytics and BI software tools such as Tableau, Power BI and others• Experienced working with data governance/data quality and data security teams.• Experienced employing Microsoft MDM (Master Data Management) and MDS.• Ability to troubleshoot complicated issues across multiple systems and driving solutions.• Effectively convey technical concepts to non-technical individuals.• Demonstrate a high level of Data Security Awareness; and• Experience with financial and or legal industry data is a plus.Qualifications:• A Bachelor's or Master's Degree in Computer Science, Statistics, Applied Mathematics, Data Management, Information Systems, Information Science or a Related quantitative field or equivalent work experience;• At least five years' experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks.• At least three years' experience working in cross-functional teams and collaborating with business stakeholders in support of a departmental and/or multi-departmental data management and analytics initiative.• Excellent communication and collaboration skill• Excellent problem solving and analytical skills.• Must be highly effective within a collaborative environment; and• Must be able to independently resolve issues and efficiently self-direct work activities based on the ability to capture, organize, and analyze information.Compensation: $120,000 - 175,000 base salary, plus incentives and an excellent benefits package.Applicants must be authorized to work for any U.S. employer.Staff Smart, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, genetic information, disability status, or any other characteristic protected by law.
Data Engineer
Federal Reserve Bank (FRB), New York
CompanyFederal Reserve Bank of New YorkWorking at the Federal Reserve Bank of New York positions you at the center of the financial world with a unique perspective on national and international markets and economies. You will work in an environment with a diverse group of experienced professionals to foster and support the safety, soundness, and vitality of our economic and financial systems.    The Bank believes in work flexibility to balance the demands of work and life while also connecting and collaborating with our colleagues in person. Employees can expect to be in the office a couple of days per week as needed for meetings and team collaboration and should live within a commutable distance. What we do:   As a member of Markets Technology Delivery supporting the Markets business domain; the area responsible for the Auctions, Trading Desks and Operations, you will contribute to financial applications and tools in support of Markets’ auctions, trading, operations planning, and execution. You will be part of an agile squad that requires close collaboration with other members of the technology team, business users, and other development team members to solve for integration, and analytics use cases.Your role as a Data Engineer: In this role you will be responsible for designing, developing, and maintaining data pipelines in support of data management functions such as data engineering, data integration and data quality and governance activities. You must be passionate about data management with a solid background in AWS, Databricks, Python, Trino/Starburst, Databases and SQL.                                                                                                                        Design, develop, monitor, and maintain data pipelines in an AWS Gov Cloud ecosystem with AWS, Databricks, Delta Lake and Trino as the underlying platforms.Collaborate with cross-functional teams to understand data needs and translate them into effective data pipeline solutions.Establish data quality checks and ensure data integrity and accuracy throughout the data lifecycle.Automate testing of the data pipelines and configure as part of CICD.Optimize data processing and query performance for large-scale datasets within AWS and Databricks environments.Document data engineering processes, architecture, and configurations.Troubleshooting and debugging data-related issues on the AWS Databricks platform.  Integrating Databricks with other AWS products such as SNS, SQS, and MSK.What we are looking for: Bachelor's or master's degree in computer science, Information Technology, or a related field.Strong technical proficiency to contribute to data engineering task in an AWS and Databricks ecosystem.Strong technical proficiency with Spark, Trino, Python, PySpark and SQLProven ability in Gitlab with CI/CD.Proven ability in AWS Services like S3, RDS, Lambda, SQS, SNS, MSK is required.Strong SQL skills to perform data analysis and understanding of source data.Proven ability with data pipeline orchestration toolsProven ability with ETL tools and Relational databasesProven ability to troubleshoot complex data issues and implement effective solutions.Proven ability in staying updated with industry trends and emerging technologies in data engineering.Salary Range: $116500 - $200400 / year  We believe in transparency at the NY Fed. This salary range reflects a variety of skills and experiences candidates may bring to the job. We pay individuals along this range based on their unique backgrounds. Whether you’re stretching into the job or are a more seasoned candidate, we aim to pay competitively for your contributions.    Our Touchstone Behaviors—Communicate Authentically, Collaborate Inclusively, Drive Progress, Develop Others, and Take Ownership—help shape the culture of the Bank. They also provide a shared language for how we work together and achieve success, and they set clear expectations for leading with impact at every stage of your career with us. Learn more.    Benefits:  Our organization offers benefits that are the best fit for you at every stage of your career:  Fully paid Pension plan and 401k with Generous Match  Comprehensive Insurance Plans (Medical, Dental and Vision including Flexible Spending Accounts and HSA)  Subsidized Public Transportation Program  Tuition Assistance Program   Onsite Fitness & Wellness Center  And more  The New York Fed expects its employees to perform their duties with honesty, integrity, and impartiality, and without improper preferential treatment of any person. Learn more about our code of conduct and conflicts of interest rules.    The Federal Reserve Bank of New York is committed to a diverse workforce and to providing equal employment opportunity to all persons without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, age, genetic information, disability, pregnancy, or military service.    We value accessibility for all candidates and are happy to provide an accommodation or assistance. Please email us at [email protected] and we’ll be glad to help. Please note, this is a dedicated e-mail box designed exclusively to assist applications with accommodation requests in relation to our recruiting process. All other inquires including the status of applications will not receive a response from this e-mail box.     This is not necessarily an exhaustive list of all responsibilities, duties, performance standards or requirements, efforts, skills or working conditions associated with the job. While this is intended to be an accurate reflection of the current job, management reserves the right to revise the job or to require that other or different tasks be performed when circumstances change.  This position requires access to confidential supervisory information (CSI) and/or Federal Open Market Committee (FOMC) information. Access to CSI and FOMC information is limited to U.S. citizens, lawful permanent residents, individuals who meet the definition of “protected individual” under 8 U.S.C. § 1324b(a)(3), and certain other nonimmigrants. All non-U.S. citizens authorized to access CSI and/or FOMC information must sign a declaration of intent to expeditiously become a lawful permanent resident and thereafter a U.S. citizen when eligible.   Full Time / Part TimeFull timeRegular / TemporaryRegularJob Exempt (Yes / No)YesJob CategoryInformation TechnologyWork ShiftFirst (United States of America)The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.Privacy Notice
Data Engineer - ETL and Power BI
The Judge Group Inc., New York
Location: REMOTESalary: $100,000.00 USD Annually - $125,000.00 USD AnnuallyDescription: Our client is currently seeking a Data Engineer - ETL and Power BI Bachelor's degree in a quantitative discipline such as Computer Science, MIS or related field with 5 years of related experience.Related Experience includes but is not limited to: development and tuning on RDBMS technology including Oracle, SQL Server, Teradata or SingleStore.Willingness to undertake assignments involving unfamiliar subjects and demonstrate aptitude to learn quickly.Excel at communicating complex ideas and concepts both verbally and through writingExperience in Agile/Scrum development with DevOps methodologies geared toward rapid prototyping and piloting of cloud solutionsPrefer 2-3 years of knowledge and experience in the development and tuning of ETL processes using PowerCenter, Informatica Data Replication (IDR), webMethods or other comparable toolsExperience in creating, analyzing and documenting ER and Dimensional models. Prefer ERWIN experience.Unix/Linux experience is preferred. Data Engineers maintain Unix files, commands, and scripts, which requires an understanding of Unix operating system concepts.Prefer 2-3 years of experience in using the Kimball methodology to design and develop Enterprise Data Warehouses and Data MartsExperience in designing and/or developing Analytics applications using tools such as Power BI, QlikView, SAS, RapidMiner or other comparable products.Willingness to travel throughout organization and service territory and work extended hours, as requiredContact: [email protected] job and many more are available through The Judge Group. Find us on the web at www.judge.com
Data Engineer
Kforce Inc, New York
RESPONSIBILITIES:Kforce's NYC-based financial services client is looking to add a Data Engineer to their team. Responsibilities: Work on migrating applications from an on-premises location to the cloud service providers The Data Engineer will develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline Partners with business and peers in the pursuit of solutions that achieve business goals through an agile software development methodology Perform problem analysis, data analysis, reporting, and communication Work with peers across the system to define and implement best practices and standards The Data Engineer will assess applications and help determine the appropriate application infrastructure patterns Use best practices and knowledge of internal or external drivers to improve products or servicesREQUIREMENTS: Expert-level understanding of Agile, SDLC, CI/CD, DevOps; GitOps, and ProdOps is required Expert-level experience in data architecture, data types/formats, optimizing code and ETL jobs, data architecture, data modeling, data contracts - a key requirement for successful collaboration with data architects and visualization developers Expert-level professional hands-on experience in extensible data pipeline development using Databricks, Alteryx, AWS Glue and Lambda functions Expert-level professional hands-on experience with RDBMS, ETL scripting tools and IDEs, data pipeline development, and management using orchestration/monitoring tools Expert-level knowledge and experience in implementing software engineering security best practices and contributing to design/engineering for DevSecOps Expert-level experience with master data management strategies, rules-based engines, and tools for multi-stage data correlation on large data sets Experience managing deployment and leading the release of code to production Expert-level understanding of data visualization tools and requirements for business customers Expert-level experience working in agile setting or being an agile best-practice mentor Expert-level experience working in Jira, confluence, and contributing to engineering team documentation/playbooks Proven experience influencing and partnering with product management, Product Owners in translating business requirements into data and engineering specifications Expert-level expertise in SQL, Python, Scala or similar; Other object-oriented programming experience a plus The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future. We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave. Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law. This job is not eligible for bonuses, incentives or commissions. Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
Lead Data Engineer
Capital One, New York
Center 1 (19052), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. What You'll Do:Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologiesWork with a team of developers with deep experience in machine learning, distributed microservices, and full stack systemsUtilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and SnowflakeShare your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering communityCollaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowermentPerform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performanceBasic Qualifications: Bachelor's DegreeAt least 6 years of experience in application development (Internship experience does not apply)At least 2 years of experience in big data technologiesAt least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)Preferred Qualifications:7+ years of experience in application development including Python, SQL, Scala, or Java4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)4+ year experience working on real-time data and streaming applications4+ years of experience with NoSQL implementation (Mongo, Cassandra)4+ years of data warehousing experience (Redshift or Snowflake)4+ years of experience with UNIX/Linux including basic commands and shell scripting2+ years of experience with Agile engineering practicesAt this time, Capital One will not sponsor a new applicant for employment authorization for this position.The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Data EngineerSan Francisco, California (Hybrid On-Site): $213,400 - $243,500 for Lead Data EngineerCandidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate's offer letter.This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected]. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One's recruiting process, please send an email to [email protected] One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).