Cornell ECE 6775

ECE 6775

High-Level Digital Design Automation

Fall 2024

Overview

Lectures – Tuesday & Thursday 11:40am-12:55pm, Phillips 407

Instructor – Zhiru Zhang

Office hours – Thursday 5:00-6:00pm, Online

CMS – https://cmsx.cs.cornell.edu

Ed – https://edstem.org/us/courses/62024

Course Texts

Lecture slides
Ryan Kastner, Janarbek Matai, and Stephen Neuendorffer, Parallel Programming for FPGAs, arXiv, 2018.
Giovanni De Micheli, Synthesis and Optimization of Digital Circuits, McGraw-Hill, 1994.

Course Schedule

Week 1

Tue 08/27 – Introduction

Lecture Slides
Readings

Course Syllabus

Thu 08/29 – Hardware Specialization 1

Lecture Slides
Readings

W. Dally, Y. Turakhia, S. Han. Domain-Specific Hardware Accelerators. CACM 2020.

Week 2

Tue 09/03 – Hardware Specialization 2

Lecture Slides
Readings

S. Williams, A. Waterman, D. Patterson. Roofline: An Insightful Visual Performance Model for Multicore Architectures. CACM 2009

Thu 09/05 – FPGAs

Lecture Slides
Readings

Kastner, Matai, and Neuendorffer: Ch. 1.2-1.3, Ch. 3.5
A. Boutros, V. Betz. FPGA Architecture: Principles and Progression. IEEE CAS-M 2021.

Week 3

Tue 09/10 – C-Based HLS

Lecture Slides
Readings

Kastner, Matai, and Neuendorffer: Ch. 1.1, 1.4, 2.1-2.4

Thu 09/12 – Analysis of Algorithms

Lecture Slides
Readings

De Micheli: Ch. 2.1-2.3

Fri 09/13 – Lab 1 Due : CORDIC Design

Vivado HLS Setup Instructions
Assignment
Readings

Kastner, Matai, and Neuendorffer: Ch. 3.1-3.3
Xilinx, Inc. Vivado Design Suite User Guide: High-Level Synthesis. Ch. 4: pages 388-390, 555-577
(regarding the usage of Vivado HLS Tcl directives and ap_fixed).
Schaumont: A Practical Introduction to Hardware/Software Codesign, Ch. 15 CORDIC Co-processor.

Week 4

Tue 09/17 – Binary Decision Diagrams (BDDs)

Lecture Slides
Readings

De Micheli: Ch. 2.5.1 & 2.5.2
K. Brace, R. Rudell, and R. Bryant, Efficient Implementation of a BDD Package. Design Automation Conf., 1991.

Thu 09/19 – Control Flow Graph

Lecture Slides
Readings

F. E. Allen. Control Flow Analysis. Symp. on Compiler Optimization. 1970.

Fri 09/20 – HW 1 Due

Assignment

Week 5

Tue 09/24 – Static Single Assignment

Lecture Slides
Readings

R. Cytron, et al. An Efficient Method of Computing Static Single Assignment Form. ACM Symp. on Principles of Programming Languages, 1989.

Thu 09/26 – Scheduling 1

Lecture Slides
Readings

De Micheli: Ch. 2.3.4, 5.1–5.4.1
C.-T. Hwang, J.-H. Lee, Y.-C. Hsu. A Formal Approach to the Scheduling Problem in High Level Synthesis. IEEE TCAD, 1991.

Fri 09/27 – Lab 2 Due: Digit Recognition System (Part 1)

Assignment
Readings

J. Kun. K-Nearest-Neighbors and Handwritten Digit Classification.

Week 6

Tue 10/01 – Scheduling 2 (Rescheduled to Fri 10/04)

Lecture Slides
Readings

De Micheli: 5.4.2 & 5.4.3
J. Cong and Z. Zhang. An Efficient and Versatile Scheduling Algorithm Based on SDC Formulation. Design Automation Conf., 2006.
S. Dai, G. Liu, and Z. Zhang. A Scalable Approach to Exact Resource-Constrained Scheduling Based on a Joint SDC and SAT Formulation. Int'l Symp. on Field-Programmable Gate Arrays, 2018.

Thu 10/03 – Neural Network Tutorial

Lecture Slides
Readings

L. Fei-Fei, J. Johnson, and S. Yeung. Stanford CS231n Convolutional Neural Networks for Visual Recognition.

Week 7

Monday 10/07 – Lab 3 Due: Digit Recognition System (Part 2)

Tue 10/08 – Pipelining 1

Lecture Slides
Readings

B. R. Rau. Iterative Module Scheduling: An Algorithm for Software Pipelining Loops. Int'l International Symp. on Microarchitecture, 1994.
Z. Zhang and B. Liu. SDC-Based Modulo Scheduling for Pipeline Synthesis. Int'l Conf. on Computer-Aided Design, 2013.

Thu 10/10 – Pipelining 2, Resource Sharing

Lecture Slides
Readings

De Micheli: Ch. 4.3, 6.7

Fri 10/11 – HW 2 Due

Assignment

Week 8

Tue 10/15 – Fall Break

Thu 10/17 – Midterm Review & HLS Design Practice

Lecture Slides

Week 9

Tue 10/22 – In-Class Midterm Exam

Open Book, Open Notes

Thu 10/24 – Domain-Specific Programming

Lecture Slides
Readings

H. Chen, N. Zhang, S. Xiang, Z. Zeng, M. Dai, and Z. Zhang. Allo: A Programming Model for Composable Accelerator Design. ACM SIGPLAN Conf. on Programming Language Design and Implementation, 2024.

Week 10

Tue 10/29 – Deep Learning Acceleration on FPGAs

Lecture Slides
Readings

C. Zhang, P. Li, G. Sun, Y. Guan, B. Xiao, and J. Cong. Optimizing FPGA-Based Accelerator Design for Deep Convolutional Neural Networks. Int'l Symp. on Field-Programmable Gate Arrays, 2015.
H. Chen, J. Zhang, Y. Du, S. Xiang, Z. Yue, N. Zhang, Y. Cai, and Z. Zhang. Understanding the Potential of FPGA-Based Spatial Acceleration for Large Language Model Inference. ACM Transactions on Reconfigurable Technology and Systems, 2024.

Thu 10/31 – Project Guidelines

Lecture Slides
Readings

Y.-H. Lai, E. Ustun, S. Xiang, Z. Fang, H. Rong, and Z. Zhang. Programming and Synthesis for Software-Defined FPGA Acceleration: Status and Future Prospects. ACM Trans. on Reconfigurable Technology and Systems, 2021.

Week 11

Tue 11/05 – Project Meetings

Wed 11/06 – Lab 4 Due: Binarized Neural Networks

Assignment
ZedBoard Usage
Readings

R. Zhao, W. Song, W. Zhang, T. Xing, J.-H. Lin, M. Srivastava, R. Gupta, and Z. Zhang, Accelerating Binarized Convolutional Neural Networks with Software-Programmable FPGAs. Int'l Symp. on Field-Programmable Gate Arrays, 2017.

Thu 11/07 – Project Meetings

Fri 11/08 – Project Abstract Due

Week 12

Tue 11/12 – Project Meetings

Thu 11/14 – Project Meetings

Week 13

Tue 11/19 – Project Meetings

Thu 11/21 – Project Meetings

Week 14

Tue 11/26 – Project Meetings

Thu 11/28 – Thanksgiving

Week 15

Tue 12/03 – Project Meetings

Thu 12/05 – Project Meetings

Week 16

Tue 12/10 – Project Presentation

Guidelines

Fri 12/13 – Project Report Due

Guidelines