LLM Graph Visualizer

Llama-3.2-1B-Instruct

context131.1K

params1.24B

size2.30 GiB

Outline

input

decoder × 16

|

output

Press enter or space to select a node. You can then use the arrow keys to move the node around. Press delete to remove it and escape to cancel.

Press enter or space to select an edge. You can then press delete to remove it or escape to cancel.

Model

Llama-3.2-1B-Instruct

familyllama

architectureLlamaForCausalLM

dtypebfloat16

hidden_size2048

intermediate_size8192

num_hidden_layers16

num_attention_heads32

num_key_value_heads8

head_dim64

vocab_size128256

max_position_embeddings131072

rope_theta500000

tie_word_embeddingstrue

Click any node to inspect its tensors, weights, formula, and FLOPs. Use the left outline to jump between layers — click the ▸ to drill in.