+1
日增长
5,596
stars
678
forks
45
watchers
8
prs
16
issues
0
releases
README
Brendan Bycroft's Home Page & Projects This repository contains my (Brendan's) homepage, as well as a number of non-trivial projects. They are kept in a single repository for ease of deployment, as well as sharing a bunch of js utils which are otherwise a pain to share around. License: MIT (see LICENSE), except the personal homepage (src/homepage/, public/me.jpeg) and third-party assets (fonts, RISC-V tests, etc.), which retain their original rights/licenses. Projects The main projects are: LLM Visualization: 3D interactive model of a GPT-style LLM network running inference. [WIP] CPU Simulation: A 2D digital schematic editor with full a execution model, showcasing a simple RISC-V based CPU LLM Visualization This project displays a 3D model of a working implementation of a GPT-style network. That is, the network topology that's used in OpenAI's GPT-2, GPT-3, (and maybe GPT-4). The first network displayed with working weights is a tiny such network, which sorts a small list of the letters A, B, and C. This is the demo example model from Andrej Karpathy's minGPT implementation. The renderer also supports visualizing arbitrary sized networks, and works with the smaller gpt2 size, although the weights aren't downloaded (it's 100's of MBs). CPU Simulation (WIP; not exposed yet!) This project runs 2D schematic digital circuits, with a fully fledged editor. The intent is to add a number of walkthroughs, showing things such as: how a simple RISC-V CPU is constructed the constituent parts down to gate level: instruction decode, ALU, add, etc higher level CPU ideas, like various levels of pipelining, caching, etc Running Locally 1. Install dependencies: yarn 1. Start the dev server: yarn dev
Top issues
#13I just want to confirm if output is correct or not6 comments · 2023-12-16#14Do you accept translation?5 comments · 2023-12-23#12nano-GPT train for letter sorting3 comments · 2023-12-13#5Feature Request : BERT Visualisation3 comments · 2023-12-03#18how can i use the code?0 comments · 2024-04-03#16License?1 comments · 2024-01-16#2GPT-2 Viz1 comments · 2023-12-03#6the last part maybe can have more of a "goodbye" thing, I did not understand it was done0 comments · 2023-12-03