This is a REMOTE - Senior Data Engineer Position with Teradata and Databricks experience
Application Development Principal (Data Analytics) - (Only w2 consultants)
Location: Remote
Duration: 18 months+
Must Have Skills:
Teradata
Databricks
Spark/PySpark
Person is 13-15+ years' experience that takes initiative and has command of tools...works in a consultative manner vs waiting for direction and orders.
Experience working with both business and IT leaders
Duties:
Collaborate with business and technical stakeholders to gather and understand requirements.
Design scalable data solutions and document technical designs.
Develop production-grade, high-performance ETL pipelines using Spark and PySpark.
Perform data modeling to support business requirements.
Write optimized SQL queries using Teradata SQL, Hive SQL, and Spark SQL across platforms such as Teradata and Databricks Unity Catalog.
Implement CI/CD pipelines to deploy code artifacts to platforms like AWS and Databricks.
Orchestrate Databricks jobs using Databricks Workflows.
Monitor production jobs, troubleshoot issues, and implement effective solutions.
Actively participate in Agile ceremonies including sprint planning, grooming, daily stand-ups, demos, and retrospectives.
Skills:
Strong hands-on experience with Spark, PySpark, Shell scripting, Teradata, and Databricks.
Proficiency in writing complex and efficient SQL queries and stored procedures.
Solid experience with Databricks for data lake/data warehouse implementations.
Familiarity with Agile methodologies and DevOps tools such as Git, Jenkins, and Artifactory.
Experience with Unix/Linux shell scripting (KSH) and basic Unix server administration.
Knowledge of job scheduling tools like CA7 Enterprise Scheduler.
Hands-on experience with AWS services including S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch.
Expertise in Databricks components such as Delta Lake, Notebooks, Pipelines, cluster management, and cloud integration (Azure/AWS).
Proficiency with collaboration tools like Jira and Confluence.
Demonstrated creativity, foresight, and sound judgment in planning and delivering technical solutions.
Required Skills:
Spark
Pyspark
Shell Scripting
Teradata
Databricks
Additional Skills:
AWS SQS
Foresight
Sound Judgment
SQL
Stored Procedures
Databricks For Data Lake/Data Warehouse Implementations
Agile Methodologies
GIT
Jenkins
Artifactory
Unix/Linux Shell Scripting
Unix Server Administration
Ca7 Enterprise Scheduler
Aws S3
Aws Ec2
AWS SNS
Aws Lambda
AWS ECS
Aws Glue
AWS IAM
Aws Cloudwatch
Databricks Delta Lake
Databricks Notebooks
Databricks Pipelines
Databricks Cluster Management
Databricks Cloud Integration (Azure/Aws)
JIRA
Confluence
Creativity
...plans, monitors, and appraises job results; coaches, counsels and disciplines associates in conjunction with Supervisor and General Manager. Assesses repair needs and estimated time needed for repair Monitors the functions of service contractors and community...
...CDL Class A Tanker Driver Liquid Bulk Hauling (Port Everglades) Cliff Berry, Inc. Fort Lauderdale, FL In-Person Hiring Event Thursday, November 13, 2025 | 8:00 AM 2:00 PM Location: 851 Eller Drive, Fort Lauderdale, FL 33316$2500 SIGN ON BONUS Cliff...
Front Office Receptionist Hacker Dermatology (Delray Beach, FL) Hacker Dermatology - a nationally recognized, award-winning dermatology practice in the heart of Delray Beach is seeking a Front Office Receptionist to join our elite clinical team. Position ...
...Production Manager | Karl Lagerfeld Sportswear & Outerwear G-III Apparel Group New York City Metropolitan Area (On-site) Success Profile: The Production Manager plays a pivotal role in overseeing production processes for the Karl Lagerfeld Sportswear and Outerwear...
The Scientific Team at Russell Tobin & Associates is hiring a Pharmacy Technician for a world-class client in Marlborough, MA (second Shift) Required top skills: -A Pharmacy Floor Technician supports pharmacists by preparing medications for patients and ensuring all...