Back to projects
CloudData Science
CloudEco — Wildlife Detection API
Cloud-native ML inference with YOLOv8, FastAPI, Docker, Kubernetes & Terraform
Built and deployed a cloud-native wildlife detection REST API powered by a YOLOv8 model, FastAPI, Docker, Kubernetes, Terraform, and structured load testing.
PythonYOLOv8FastAPIDockerKubernetesTerraformLocustCloud InfrastructureML Deployment
Problem
Wildlife monitoring workloads needed a scalable, reproducible way to run object detection inference on cloud infrastructure without manual provisioning.
My role
Cloud / ML Engineer — designed the inference API, container strategy, Kubernetes manifests, Terraform stack, and load-testing harness.
Solution
Wrapped a YOLOv8 model in a FastAPI service, containerised with Docker, deployed to Kubernetes, and provisioned multi-node cloud infrastructure with Terraform. Locust scripts benchmarked latency, throughput, and reliability across configurations.
Challenges
- ›Balancing inference latency against pod cost across replica counts.
- ›Reproducible multi-node infrastructure across environments.
- ›Benchmarking throughput and failure rate under structured load.
Key features
- ›Deployed a cloud-native ML inference API under constrained cloud resource settings.
- ›Provisioned multi-node cloud infrastructure using Terraform Infrastructure-as-Code.
- ›Orchestrated containerised FastAPI services across Kubernetes deployments.
- ›Conducted Locust load testing to benchmark throughput, response time, failure rate, and scalability.
- ›Evaluated cloud performance using structured metrics including latency, concurrent traffic, and reliability.
Results
- ›Documented performance envelope for capacity planning.
- ›Reproducible Terraform-driven environments.
- ›Structured load-test evidence for scalability claims.
Cloud-native ML inference
Benchmarked across pod counts
Reproducible IaC deployments