Data Engineer Salary in State of New York, USA

Location: REMOTESalary: $70.00 USD Hourly - $75.00 USD HourlyDescription: Title: Data Engineer Level 3 Location: Remote Duration: 6 Months contractJob DescriptionPosition Overview As a Data Engineer, you will play a pivotal role in developing and delivering technological solutions aligned with targeted business outcomes. Your focus will be on data architecture and information delivery, treating data as a valuable enterprise asset. You'll adhere to reusable standards, design patterns, and guidelines to ensure streamlined integration and operational efficiency. Collaboration with cross-functional teams, including direct engagement, will be essential. Demonstrating our core values of respect, honesty, integrity, diversity, inclusion, and safety is paramount.Additional Details Top 3 Technical Skills: Databricks, PySpark, Delta Live Tables, Delta Sharing. Soft Skills: Excellent communication. Project Focus: Data Integration Modernization. Team Details: 12-member Agile hybrid team. Work Location: Remote. Travel Requirement: None. Working Hours: 40 hours per week.Key Responsibilities Data Solutions and Integration: Utilize enterprise standards for data domains and solutions. Streamline operational and analytical use of data. Ensure clarity between ongoing projects, escalating issues when necessary. Collaborate directly on data initiatives. Innovative Technologies and Transformation: Leverage cutting-edge technologies to enhance existing data assets. Renovate, extend, and transform core data platforms. Address gaps between current and future states through high-level migration plans. Architectural Decision-Making: Contribute to cost/benefit analysis for leadership. Detect critical deficiencies in technology environments. Recommend solutions for improvement. Data Asset Reuse and Documentation: Promote the reuse of data assets. Manage the data catalog for reference. Draft architectural diagrams and interface specifications.Qualifications Required: 4+ years of Python experience. Strong SQL skills, including querying with extensive join conditions and conditional updates. DevOps proficiency (Linux, GitHub, Bash). Experience with CI/CD lifecycles. Unit, integration, and regression testing expertise. Familiarity with static code analysis tools, Linters, and adherence to PEP 8 standards. Exposure to Microsoft Azure and/or Google Cloud Platform. Agile SCRUM project experience. Highly Desired: Data Management expertise (Databricks, PySpark, Spark Structured Streaming, Delta Live Tables, Delta Sharing). Expert knowledge of SQL. Familiarity with Streaming Technologies (Apache Kafka, Azure EventHubs, Avro). DevOps skills (GitHub Actions, Terraform, Artifactory). Desired: Knowledge of Java, SpringBoot, Kubernetes, Docker, and NoSQL databases. Contact: [email protected] job and many more are available through The Judge Group. Find us on the web at www.judge.com

Experience Level: Experienced HireCategories:Engineering & TechnologyLocation(s):7 World Trade Center, 250 Greenwich Street, New York, New York, 10007, USMoody's is a developmental culture where we value candidates who are willing to grow. So, if you are excited about this opportunity but don't meet every single requirement, please apply! You may be a perfect fit for this role or other open roles.Moody's is a global integrated risk assessment firm that empowers organizations to make better decisions.At Moody's, we're taking action. We're hiring diverse talent and providing underrepresented groups with equitable opportunities in their careers. We're educating, empowering and elevating our people, and creating a workplace where each person can be their true selves, reach their full potential and thrive on every level. Learn more about our DE&I initiatives, employee development programs and view our annual DE&I Report at moodys.com/diversityJob Title: Senior Data EngineerJob Description: We are in search of a seasoned Data Engineer to lead the enhancement of our regulatory data submission process and play a key role in designing and building data marts and data warehouses in AWS. This role is central to our data operations, requiring the successful candidate to manage and rectify submission failures and implement changes in the data submission process as per evolving needs.Recently, we have integrated new technology into our regulatory reporting environment. This incorporation has opened up opportunities for redefining our data processes. As a Senior Data Engineer, you will play a crucial role in shaping the future of our regulatory reporting processes.The preferred candidate should be proactive and driven to excel, with a deep understanding of SQL (Sybase or Oracle). Key Responsibilities:Supervise the regulatory data submission process, ensuring data accuracy and timely deliveryImplement required changes to the regulatory data submission processContribute to the enhancement and evolution of our regulatory reporting technologyPlay a pivotal role in decision-making for the future of our regulatory reporting Essential Skills:Experience in constructing data pipelines for a data warehouse and data mart in AWSDeep understanding of AWS cloud technology, including data archiving and its data services such as Redshift, Glue, Kinesis, and S3Expert in SQL and Advanced SQL(Sybase or Oracle)Experience with ETL processes Desirable Skills:Basic knowledge of Python for AWS Lambda functionsFamiliarity with AWS data visualization tools like Quicksight or third-party tools such as Tableau or Power BIFamiliarity with AlteryxFamiliarity with Tableau or Power BI This role offers the unique opportunity to work in a dynamic, fast-paced environment and make a substantial contribution to the optimization of our regulatory reporting processes. We are looking for someone with a proven track record in data engineering who can drive our data operations to new heights. For US-based roles only: the anticipated hiring base salary range for this position is [[$127,500 - [[$184,950, depending on factors such as experience, education, level, skills, and location. This range is based on a full-time position. In addition to base salary, this role is eligible for incentive compensation. Moody's also offers a competitive benefits package, including not but limited to medical, dental, vision, parental leave, paid time off, a 401(k) plan with employee and company contribution opportunities, life, disability, and accident insurance, a discounted employee stock purchase plan, and tuition reimbursement.Moody's is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, sex, gender, age, religion, national origin, citizen status, marital status, physical or mental disability, military or veteran status, sexual orientation, gender identity, gender expression, genetic information, or any other characteristic protected by law. Moody's also provides reasonable accommodation to qualified individuals with disabilities or based on a sincerely held religious belief in accordance with applicable laws. If you need to inquire about a reasonable accommodation, or need assistance with completing the application process, please email [email protected]. This contact information is for accommodation requests only, and cannot be used to inquire about the status of applications.For San Francisco positions, qualified applicants with criminal histories will be considered for employment consistent with the requirements of the San Francisco Fair Chance Ordinance.This position may be considered a promotional opportunity, pursuant to the Colorado Equal Pay for Equal Work Act.Click here to view our full EEO policy statement. Click here for more information on your EEO rights under the law. Click here to view our Pay Transparency Nondiscrimination statement. Click here to view our Notice to New York City Applicants.Candidates for Moody's Corporation may be asked to disclose securities holdings pursuant to Moody's Policy for Securities Trading and the requirements of the position. Employment is contingent upon compliance with the Policy, including remediation of positions in those holdings as necessary.For more information on the Securities Trading Program, please refer to the STP Quick Reference guide on ComplianceNetPlease note: STP categories are assigned by the hiring teams and are subject to change over the course of an employee's tenure with Moody's.Moody's Corporation is a Government contractor subject to the Vietnam Era Veterans' Readjustment Assistance Act of 1974, as amended by the Jobs for Veterans Act of 2002, 38 U.S.C. 4212 (VEVRAA), which requires Government contractors to take affirmative action to employ and advance in employment: (1) disabled veterans; (2) recently separated veterans; (3) active duty wartime or campaign badge veterans; and (4) Armed Forces service medal veterans.VEVRAA Federal ContractorWe Request Priority Protected Veteran and Disabled Referrals for all of our locationsPlease contact Donna Hutchinson, Assistant Vice President, Talent Attraction for any questions regarding this listing.PDN-9bf2e0e2-a808-4cb6-878d-0c43e26b0080

Why Hearst Magazines? Hearst Magazines is one of the largest publishers in the world, with more than 25 brands, including Cosmopolitan, ELLE, Esquire, Good Housekeeping, Harper's BAZAAR, Popular Mechanics, and O the Oprah Magazine. We reach more than 150 million people every month in the United States alone. But we're more than just our magazines. We engage our audience across all mediums and channels - print, digital, video and social – with sophisticated content creation, distribution and data capabilities. We create, package and sell products with cutting-edge technology and proprietary platforms. Together, we are reinventing publishing for the 21st century Your Impact: As a Data Engineer at Hearst Magazines, you will work with a team of engineers, data scientists, data analysts, and product managers to deliver best in class, scalable and extensible data solutions using GCP and other cloud-based technologies. You will be tasked with designing, building, testing, integrating, managing, and optimizing data from a variety of sources and destinations. The role requires someone who loves data, understands enterprise information systems, has strong business sense, and can put these skills into action.

Opportunity Details Full Time Data Engineer III Remote Outcomes. Delivered.Voyatek, formerly GCOM Software and OnCore Consulting, delivers outcome-driven technology solutions to public sector agencies and higher education institutions nationwide. For example, our technology:Facilitates access to nutritious food for children of mothers participating in the WIC programSupports first responders in reducing opioid overdoses within their communitiesEmpowers colleges and universities to identify and thwart financial aid fraudEquips teachers with valuable insights to identify students requiring additional supportEnhances efficiency for state tax agencies, leading to 99% faster return processing and quicker refunds for taxpayersWith a focus on Tax & Revenue, Health & Human Services, and Justice & Public Safety, Voyatek combines the scale to support large complex projects with the agility and accessibility of a boutique solutions provider. Together, Voyatek and its customers work to improve population wellbeing, create safer communities, and foster a thriving economy. We're more than a technology company -- we're an outcomes company. We encourage our employees to think differently, ask tough questions, and relentlessly pursue what's best for our customers and the residents they serve. We believe that the value of technology is defined by its human impact. If you agree, you've come to the right place. Voyatek is seeking applicants to occupy the position of Data Engineer within our team. This role offers remote work opportunities.Key Responsibilities: Build, maintain, and test data pipelines to ingest data from multiple sources, using server-side JavaScript for data harmonization and backend processingMaintain mapped schemasBuild analytic datasets in conjunction with data scientists to support machine learning and advanced analyticsDevelop and maintain processes for manipulating data, securing data, and ensuring data reliabilityDevelop APIs to support complex queries against the database and user interactions within applicationsCreate unit tests and documentation as part of standard service/API developmentDevelop code in adherence to security policies and proceduresResearch and introduce best practices and new processes as needed to solve business problems and improve existing solutionsCollaborate with other data engineers, developers, and project staff in an Agile framework through the entire SDLC to understand requirements, design, build, and deploy data pipelines to support proprietary software applicationsDevelop code using Git for source code management and collaborationQualifications: Bachelors in math, data science, computer science, or related field or equivalent combination experience of education and experience5 -8 years of professional experience3+ year experience working with NoSQL database technologies (such as MarkLogic, MongoDB, ArangoDB, etc.)3+ years of experience with Server-Side JavaScriptExperience developing OpenAPI documentation or working with YAMLExperience with Apache NiFi or similar ETL toolUnderstanding of the SDLC and familiarity with modern Agile development methodologiesAbility to articulate coding rationale and problem-solving thought processEnthusiastic about data integration and reliabilityExcellent verbal and written communication skillsAbility to work remotely, be self-motivated, and innovative Strong collaboration skills and ability to work well in a team environmentThe wage range for this role takes into account the wide range of factors that are considered in making compensation decisions. This includes, but is not limited to, skill sets, experience and training, licensure and certifications, and geographic location. At Voyatek, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current annual range is $80,000.00-$129,300.00If you think you are a good fit for us, we encourage you to apply. Check out our career website for all open positions!Voyatek provides equal employment opportunities to all employees and applicants for employment without regard to race, color, creed, ancestry, national origin, citizenship, sex or gender (including pregnancy, childbirth, and pregnancy-related conditions), gender identity or expression (including transgender status), sexual orientation, marital status or domestic violence victim status, religion, age, disability, genetic information, service in the military, or any other characteristic protected by applicable federal, state, or local laws and ordinances. Equal employment opportunity applies to all terms and conditions of employment, including recruitment and hiring, job assignment/placement, promotion, upgrading, demotion, termination, layoff, recall, transfer, leave of absence, rates of pay or other compensation, internship, and training.

New York, NY | Providence, RIFull timeREQ-2024-391At Customers Bank, we believe in working hard, working smart, working together to deliver memorable customer experiences and having fun. Our vision, mission, and values guide us along our path to achieve excellence. Passion, attitude, creativity, integrity, alignment, and execution are cornerstones of our behaviors. They define who we are as an organization and as individuals. Everyone is encouraged to have personal development plans. By doing so, our team members are on their way to achieve their highest potential and be successful in their personal and professional lives.Position Skills IDPosition Title: Fintech Data EngineerSalary Range: The expected salary range for this position is $95,000 - $150,000. This is a good faith estimate of what we expect to pay for this position. The final salary figure will consider skill level, experience, and location.Report to Manager: VP /Business AnalystDepartment: FintechWork Location: Providence, RI, New York, NY, West Reading, PA or Malvern, PA – Hybrid, coming into the office at least 3 days per week with Monday, Tuesday, and Thursday being set days.This position is open to fully remote for those more than 50 miles away from an established Customers Bank locationWho is Customers Bank?Founded in 2009, Customers Bank is a super-community bank with over $22 billion in assets. We believe in dedicated personal service for the businesses, professionals, individuals, and families we work with.We get you further, faster. Focused on you: We provide every customer with a single point of contact. A dedicated team member who’s committed to meeting your needs today and tomorrow.On the leading edge: We’re innovating with the latest tools and technology so we can react to market conditions quicker and help you get ahead.Proven reliability: We always ground our innovation in our deep experience and strong financial foundation, so we’re a partner you can trust.What you’ll do:We are looking for an energetic data engineer to work in our Capital Markets division at Customers Bank. This person will create processes to load data from many sources and produce reporting to help drive the Capital Markets team’s activities.The data involved will include quality assurance reporting about our lending portfolio, structured finance activity, and drive interaction and decision making between members of the team. This person will also be responsible to manage and improve overall database performance, with the goal of improving the availability of data to the Capital Markets team. This drives the business of the bank for a ~2bn allocated portfolio of loans. ResponsibilitiesCreate, implement, and improve ETL processes. This includes new files from new partners, changes over time to existing files, and general automation of reporting tasks. Design data specifications, help gather requirements for data infrastructure, and steer product grooming/roadmap planning Generate new reporting, including financial reporting and quality control reports for a large loan portfolio. Fine tune the database to ensure high performance for large datasets. Gather data specification documentation from many disparate sources. Detect and resolve problems within partner data, including formatting changes, missing data elements, and illogical data points. Flexibility with working with new data, partners, products, or processes within a dynamic team.What do you need?Recent or upcoming graduates with less than two years of professional experience will not be considered for this role.2-4 (Engineer) or 5-7 (Senior Engineer) years of professional experience in one or multiple of the following2 years demonstrated relational database knowledge, including relational table design and performance tuning.BS/BA in Computer Science or a related field and/or 3-5 years of additional equivalent professional experience. Other degrees will also be considered.Data analytics tools (e.g. Looker, Tableau, PowerBI, etc.)Proficiency in Microsoft Office (Excel, Access, and PowerPoint especially)Exceptional executor, not afraid of getting into the weeds and rolling up sleeves to make sure whatever is in their zone of ownership gets done.Willingness to dive deeply into data from many partners to understand all aspects of a loan’s behavior.Robust communication, collaboration, and leadership skills in a team environment as well ability to engage a hybrid remote organization spanning multiple time zones and states.Knowledge of consumer lending or structured finance preferable.Must be legally eligible to work in the US without sponsorship.Customers Bank is an equal opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also provide “reasonable accommodations”, upon request, to qualified individuals with disabilities, in accordance with the Americans with Disabilities Act and applicable state and local laws. Diversity Statement: At Customers Bank, we believe in working smart, working together, and having fun while delivering innovative solutions and memorable experiences for our customers. We are committed to the continual advancement of a culture which reflects the value we place on diversity, equity, and inclusion. We honor the diverse experiences, perspectives, and identities of our team members, and we recognize that it is their passion, creativity, and integrity that drives our success. Step into your future with us! Let’s take on tomorrow.Founded in 2009, Customers Bank is a super-community bank with $20.3 billion in assets at June 30, 2022. We believe in dedicated personal service for the businesses, professionals, individuals and families we work with. We offer banking and loan services across Florida, Illinois, Massachusetts, New Hampshire, New Jersey, New York, North Carolina, Pennsylvania, Rhode Island and Texas.Customers Bank is a member of the Federal Reserve System with deposits insured by the Federal Deposit Insurance Corporation. Customers Bank is an equal opportunity lender. Customers Bank takes pride in delivering extremely high levels of customer service while charging comparatively very low fees; service that makes our clients say, “Wow.”Customers Bank, with its headquarters located in Malvern, Pennsylvania, is a subsidiary of Customers Bancorp, Inc., a bank holding company. The voting common shares of Customers Bancorp, Inc. are listed on the New York Stock Exchange under the symbol CUBI.Customer Service driven VEVRAA Federal Contractor, seeking priority referral of qualified protected veterans.Customers Bank will provide consideration for employment to qualified applicants without regard to their race, color, religion, national origin, sex/ gender, sexual orientation, gender identity, protected veteran status or disability.PI240969857

DESCRIPTIONIt’s an exciting time to be on the Amazon Shopping Videos team. We have millions of videos that help customers shop every day. These include product demos, customer reviews, buying guides, and how-to guides. How do we choose the right videos to show, to the right customer, at the right time, helping them make the right shopping decision? That’s where you come in.Data is at the center of every product we develop as we create new features and products that serve the needs of our growing base of consumers and brands. As a Data Engineer on the Amazon Video Shopping team, you will lead the design and implementation of systems capable of processing, storing and querying large datasets. You will partner with product managers and engineers to help build and support data needs of partner teams, reporting solutions, machine learning systems and analytics. About the teamNow more than ever, customers watch videos when they shop. Videos and livestreams make shopping easier and more fun, whether a customer is researching a product or tuning in to chat with their favorite content creator live. The Amazon Shopping Video (ASV) team’s mission is to enable customers to find inspiration, information, entertainment, and community through videos at any point in their shopping journey. If you are interested in building an entertainment product, enjoy a creative and fast-paced working environment, and want to work on a strategic new initiative, join our team today!We are open to hiring candidates to work out of one of the following locations:New York, NY, USA | Seattle, WA, USABASIC QUALIFICATIONS- 3+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelines- Experience with SQLPREFERRED QUALIFICATIONS- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $105,700/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. Applicants should apply via our internal or external career site.

Yahoo Mail is the ultimate consumer inbox with hundreds of millions of users. It's the best way to access your email and stay organized from a computer, phone or tablet. With its beautiful design and lightning fast speed, Yahoo Mail makes reading, organizing, and sending emails easier than ever. A Little About Us The Yahoo Mail engineering team develops solutions powering our mail brands, including a next-generation infrastructure that we are 100% moving to a native public cloud architecture. The Mail Intelligence AI/ML platform is responsible for building intelligent, smart capabilities at scale to discover interests, reveal habits, and deeply personalize user journeys for Yahoo Mail and across the entire Yahoo's ecosystem. We are looking for innovative, entrepreneurial, and passionate engineers. We are engineers who strive to deliver to our users only the absolute best and are willing to meticulously refine the details to achieve this goal. While Engineering is a core puzzle piece, we believe that your passion and owner mindset is as crucial as the high engineering standards, code quality and world-class architectural skills that we expect from our engineering teams. We process billions of mail messages using cutting edge algorithms in areas including but are not limited to: Natural language processing, GenAI, Large Language Models, Machine Learning techniques, big data processing in order of petabytes to: Extract information, build mail content and user knowledge, and interconnect different sources to identify, highlight and amplify what matters. Our work spans many technical challenges highly rewarding and fulfilling to high-caliber engineers hungry for impactful problem statements. You will build tools and workflows to make it easier to manage and act on this vast information. You will also be working on AI-based data infrastructure, supporting new functionalities on existing platforms, and mining data for analytics insights and product features. Our Hadoop clusters are among the largest few in the world, at double-digit petabyte scale. Developing this infrastructure presents many technical challenges in the areas of efficient query processing, large-scale data processing, machine learning and modeling, as well as satisfying complex business rules. If you are someone who is passionate about harnessing data at insane scale, enjoys working with new technologies, setting up petabyte data infrastructures and implementing new machine learning solutions and metrics systems, we want to hear from you! Your Day: You will research and develop innovative algorithms for information retrieval, processing and ranking.Take end to end ownership of Machine Learning-based distributed data systems - especially focused on data pipelines for data collection, validation and active learning and batch inference.Work with other engineers to implement algorithms and systems in an efficient wayInteract with data analysts, data scientists, product managers, and software engineers to understand business problems, technical requirements to deliver data solutionsLead data investigations to troubleshoot data issues that arise along the data pipelinesMaintenance and improvement of released systemsEngineering consulting on large and complex warehouse data Qualifications: BS with 7+ years of relevant Industry experience/M.S. in Computer Science with 5+ years of relevant Industry experience. Computer Science graduate ideally with specialization in Data Engineering or Machine LearningExperience in Hadoop technologies (Map/Reduce, Oozie, Pig, Hive, Spark, Kafka, HBase, Storm,).Strong fundamentals: algorithms, distributed computing, data structure, databaseFluency with at least one of:Java/Python/C++Self-driven, challenge-loving, detail oriented, teamwork spirit, excellent communication skills, ability to multitask and manage expectations Nice to have: Experience in any of: machine learning, analytics, data mining, or data mart and warehouseExperience with Deep Learning platforms (Tensorflow/Keras/Spark MLlib) and SQL/Unix/ShellExperience with machine learning algorithms, NLP, and/or statistical methods a big plusYahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form ( www.yahooinc.com/careers/contact-us.html ) or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.At Yahoo, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion ( www.yahooinc.com/diversity/ ) page to learn more.The compensation for this position ranges from $128,250.00 - $266,875.00/yr and will vary depending on factors such as your location, skills and experience. The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions, in addition to equity incentives. Yahoo provides industry-leading benefits including healthcare, 401K savings plan, company holidays, vacation, sick time, parental leave and an employee assistance program. Eligibility requirements apply.Yahoo has a high degree of flexibility around employee location and hybrid working. In fact, our flexible-hybrid approach to work is one of the things our employees rave about. Most roles don't require specific regular patterns of in-person office attendance. If you join Yahoo, you may be asked to attend (or travel to attend) on-site work sessions, team-building, or other in-person events. When these occur, you'll be given notice to make arrangements. If you're curious about how this factors into this role, please discuss with the recruiter. Currently work for Yahoo? Please apply on our internal career site.

Senior Data EngineerHybrid - NYCOur client is looking for a Data Engineer with experience in building and optimizing data pipelines, performing ELT processes, and working within a modern data stack.Top 3 skills needed: BigQuery, DBT, Airflow (or another orchestrator) Responsibilities:Collaborate with cross-functional teams and stakeholders to understand data requirements and implement solutions accordingly.Work closely with data scientists to implement efficient ELT processes and performant SQLEnsure data observability, quality, and integrity throughout the data pipeline.Utilize orchestration tools such as Apache Airflow, Dagster, or Luigi to manage and schedule dbt workflows.Optimize and tune existing data pipelines for improved performance, lower cost, and scalability.Design, develop, test, and maintain data architecture to facilitate the extraction, storage, and transformation of raw data for downstream utilization by data scientistsRequirements:5-8+ years of experience in data engineering or a similar role.Proficiency in building and maintaining data pipelines using tools like Luigi, Dagster, Apache Airflow, or similar.Programming skills in Python with a strong sense of engineering best practices.Experience working with cloud-based data storage solutions (ideally Google Cloud Storage)Familiarity with dbt best practicesExperience with SQL for querying and manipulating large datasets.Familiarity with data modeling concepts and tools.Experience in working with columnar warehouses (ie Bigquery) and relational databases (ie Postgres)Compensation: $160,000-$190,000 base + equity **No visa sponsor/transfers available at this time. ** No C2C/C2HResearch indicates that men will apply to a role when they only meet 50-60% of the descriptions, however, when looking at women and other minority groups, they can look for up to a 99% match in order to apply to a role. If you feel you are a fit for our role, please still apply, don't worry if you don't tick every single box. We'd still love to hear from you. We encourage underrepresented talent to apply to all our roles & support accessibility needs.

Global hospitality company is looking for an experienced Data Engineer for their Midtown NYC headquarters. Responsibilities:Lead the in-house development of ETL/ELT data pipelines and data science projects.Create and own data products, such as a recommendation engine or predictive model.Provide key insights and analyses to senior stakeholders and executives.Work with the Data Engineering team to design and develop data models.Qualifications And Requirements5+ years of relevant professional experience in building AWS big data pipelines using Apache Spark.Strong hands-on experience with programming in Python.Expertise in SQL and analytical data modeling.Hands-on experience in pipeline orchestration tools, like Apache Airflow.Experience in PostgreSQL, Redshift, S3, AWS Lambda, Kinesis and Athena.Previous work with cloud-based BI tools (such as Looker, and Quicksight) is a plus.Strong organizational, problem-solving, and communications skills (must be able to do basic technical writing)

Senior Data EngineerMy client is a leading SaaS (Software as a Service) company at the forefront of innovation. They are seeking an experienced Senior Data Engineer to architect, build, and optimize the robust data infrastructure that powers their cutting-edge platform.Responsibilities:- Design and implement scalable, fault-tolerant data pipelines and data platforms using modern technologies- Develop and maintain complex ETL processes for ingesting, transforming, and integrating data from diverse sources- Collaborate closely with data scientists, analysts, and engineering teams to ensure data quality and accessibility- Optimize data workflows and systems for performance, reliability, and cost-efficiency at scale- Implement and enforce data governance policies, best practices, and security measures- Automate data processes and deployments using tools like Airflow, Kubernetes, and Terraform- Mentor and guide junior data engineers, promoting best practices and knowledge sharingRequirements:- 5+ years of experience as a Data Engineer or in a similar data-intensive role- Deep expertise in Python, SQL, and cloud data platforms (e.g., AWS, GCP, Azure)- Proven proficiency in data pipeline tools (e.g., Apache Airflow, Apache Kafka, Apache Spark)- Extensive experience with data warehousing and data lake technologies (e.g., Snowflake, BigQuery, Redshift)- Strong understanding of data modeling, ETL processes, and data integration patterns- Familiarity with containerization technologies (e.g., Docker, Kubernetes)- Excellent problem-solving, analytical, and debugging skills- Strong communication and collaboration abilitiesGreat to Have:- Experience in the SaaS industry or with cloud-based applications- Knowledge of streaming data processing and real-time data pipelines- Familiarity with machine learning and AI platforms- Background in software engineering or computer science- Experience mentoring and leading data engineering teamsThrough the internal and market data my client has collected, they expect the salary range for this position to be $140,000 - $180,000 per year. Your actual compensation will be determined based on your skills, qualifications, and experience.