J ob Python Development - Machine Learning Experience - (Notebooks, Frameworks like Tensorflow/pytorch and libraries like pandas, numpy, etc.) - Jenkins - used to continually create and test software projects, making it easier for developers and DevOps engineers to integrate changes to the project and for consumers to get a new build.
- Docker experience for containerization - Any experience with AWS - AWS foundational services (EC2, IAM, AIM, Storage, SNS/SQS) - Relational Database Experience (Oracle/SQL Server) - Specifically Experience doing data transformation activities - Need Excellent communication Role will be to support 24/7 Enterprise Platforms, from Home Grown applications to Machine Learning Model - Manage and maintain high-tier, mission-critical platforms ensuring 24/7 availability and performance.
- Support machine learning initiatives by setting up and managing ML environments, utilizing notebooks, TensorFlow, PyTorch, and relevant libraries.
- Develop, enhance, and maintain applications using Python, adhering to best practices and coding standards.
- Utilize GitHub for version control, ensuring code quality and collaboration among team members - Implement continuous integration and continuous deployment (CI/CD) pipelines using Jenkins for efficient software delivery.
- Containerize applications using Docker and orchestrate them efficiently with Kubernetes for scalability and resilience.
- Configure and manage AWS foundational services such as EC2, IAM, AIM, storage solutions, and SNS/SQS for seamless integration and operation.
- Collaborate with the data team to design, develop, and optimize data stores and databases for efficient data storage and retrieval.
- Implement data transformations and ETL processes to ensure data integrity and consistency.
- Implement and manage Kafka for real-time data streaming and event-driven architectures.
- Utilize Spark and Spark Streaming for large-scale data processing and analytics, ensuring optimal performance and scalability.
- Implement infrastructure as code (IaC) using Terraform for provisioning and managing cloud resources.
- Automate infrastructure provisioning, configuration, and management tasks using Ansible for increased efficiency and consistency.
(ref:hirist.tech)