Senior Specialist - Data Engineering (Python Automation Lead)
Work Location- Austin, TX
Job Description:
Seeking a Senior Specialist with 7 to 11 years of experience in Python and data technologies including Flask Apache Spark Scala and Nginx to design and implement scalable data driven solutions
Develop and maintain high performance data processing applications using Apache Spark and Scala Build and deploy RESTful APIs and web services using Flask framework.
Utilize Python extensively for data manipulation automation and integration tasks Configure and optimize Nginx as a reverse proxy and load balancer for web applications.
Collaborate with cross functional teams to design scalable data architectures within the Python Data skill cluster.
Ensure code quality performance and reliability through rigorous testing and best practices.
Stay updated with the latest trends and advancements in data engineering and Python ecosystems.
Lead the design and development of data processing pipelines leveraging Apache Spark and Scala.
Architect and implement backend services and APIs using Flask to support data driven applications. Manage deployment and configuration of Nginx servers to ensure high availability and security Mentor junior developers and provide technical guidance in Python and related technologies.
Work closely with data scientists’ analysts and product teams to translate requirements into technical solutions.
Optimize existing data workflows for performance and scalability Participate in code reviews troubleshooting and resolving complex technical issues
Show more Show less
Requirements
7 to 11 years of experience in Python and data technologies including Flask Apache Spark Scala and Nginx
Additional Instructions
Seeking a Senior Specialist with 7 to 11 years of experience in Python and data technologies including Flask Apache Spark Scala and Nginx to design and implement scalable data driven solutions
Develop and maintain high performance data processing applications using Apache Spark and Scala
Build and deploy RESTful APIs and web services using Flask framework.
Utilize Python extensively for data manipulation automation and integration tasks
Configure and optimize Nginx as a reverse proxy and load balancer for web applications.
Collaborate with cross functional teams to design scalable data architectures within the Python Data skill cluster.
Ensure code quality performance and reliability through rigorous testing and best practices.
Stay updated with the latest trends and advancements in data engineering and Python ecosystems.
Lead the design and development of data processing pipelines leveraging Apache Spark and Scala.
Architect and implement backend services and APIs using Flask to support data driven applications.
Manage deployment and configuration of Nginx servers to ensure high availability and security
Mentor junior developers and provide technical guidance in Python and related technologies.
Work closely with data scientists’ analysts and product teams to translate requirements into technical solutions.
Optimize existing data workflows for performance and scalability
Participate in code reviews troubleshooting and resolving complex technical issues
