Topic
Python
Python is the language nearly everything here is written in, used as an engineering language rather than a scripting one. The open source libraries are the clearest examples: a Spark pipeline framework with a typed plugin contract, and a Bayesian filtering library that follows the scikit-learn estimator convention without depending on it. The writing covers packaging a Python library properly so that other people can install it and depend on it.
7 work · 1 writing · Wikidata Q28865
Work
- Climate forecasting and geospatial ML at IBM ResearchApplied ML research at IBM Research: climate forecasting models deployed into IBM PAIRS Geoscope, published work, and a provincial COVID-19 risk dashboard.
- Decision support systems for municipalities at the CSIRDjango based predictive analytics and decision support systems serving 17 municipalities, including the City of Cape Town, built at the CSIR.
- Generator optimisation and streaming at VodacomReal time analytics and optimisation for a national telecoms network: generator dispatch across 15,000+ sites and tens of millions of events a day.
- Insurance data science: telematics, flood risk and MLOpsLeading insurance data science at ABSA Insurance: telematics processing cut from months to under a day, flood risk across 230,000+ properties, MLOps.
- Student success analytics and recommendations at WitsAnalytics and a clustering based recommendation system for student success at Wits, with over R2 million a year in subsidy impact attributed to it.
- TFiltersPy: Kalman and particle filters for PythonTFiltersPy is an open source Python library of Bayesian filters: Kalman, extended, unscented, ensemble and particle, behind one scikit-learn style API.
- Ubunye Engine: portable Spark pipelines for data and MLUbunye Engine is an open source Python framework for config driven Spark pipelines. The same task folder runs on a laptop, Docker, Kubernetes or Databricks.
Writing
Related topics
Subjects that share work with this one. Those with their own page are linked.
- Data engineering
- Apache Spark
- Decision support systems
- MLOps
- Open source software
- Climate risk
- Data science
- Databricks
- Docker
- Geospatial machine learning
- Kubernetes
- Technical leadership