AI Hardware Applications

This is the course website for ECE 495 - AI Hardware Applications, Fall ‘23.

Many of the pages are Jupyter Notebooks and can be opened in Google Colab by clicking the launch button 🚀 at the top right of the page!

Machine Prediction

• 1. Hello, Colab!
• 2. Networks and Tooling
• 3. Prediction Machines and ML Workflow
• 4. ICE: K-Means Clustering
• 5. Cloud Hosting
• 6. MNIST Digits with Neural Network
• 7. Lab: Serving Digits with FastAPI
• 8. C&C: Prediction and Dimensionality

Neural Networks

• 9. Tensors and Dimensionality
• 10. ICE: GPU Acceleration
• 11. ICE: Whisper Transcription
• 12. Convolutional Neural Network
• 13. Transfer Learning
• 14. Lab: Cats vs. Dogs
• 15. Herding 🐱 🐶
• 16. C&C: Deep Neural Networks

NVIDIA Jetson

• 17. Containerization
• 18. Diffusion Image Generation
• 19. Containers Part 2
• 20. YOLO

Tensorflow Lite Micro

• 21. M4-Cortex Processor
• 22. Wake Word Detection

Natural Language Processing

• 23. Text Vectorization
• 24. Transformers
• 25. Emergence and Ethics of LLMs
• 26. Prompt Engineering

Final Block

• 27. Final Project
• 28. Final Project
• 29. Final Project
• 30. Final Project
• 31. Final Project
• 32. Super Computers
• 33. Final Project
• 34. Final Project
• 35. Bias and Ethics
• 36. Final C&C
• 37. LLM Red Team 1
• 38. LLM Red Team 2
• 39. Wrap and Critique

ECE 495: AI Hardware Applications 1.5 (1) This course will require students to engage with Artificial Intelligence algorithms and frameworks to train and deploy machine learning models. Students will explore which types of problems are appropriate for AI to solve, data pipelining, hardware accelerated training, and inference on hardware and power constrained devices. Assignments may include system design, programming, and book reviews. Classes are organized as lecture and laboratories devoted to applying models. Prereq: CompSci 110. Sem hrs: 1.5

Course Text

In addition to lots of online resources, we use TinyML by Pete Warden.

The book is available for free from O’Reilly via DoD MWR Libraries.