Demos
Open demo gallery
Two-Moon Classification%20--%3e%3cpath%20d='M%2080%2060%20Q%20140%2040%20160%20100%20T%20100%20160%20T%2060%20100%20Z'%20fill='%23fff9c4'%20stroke='%232d2d2d'%20stroke-width='4'%20stroke-dasharray='8%206'%20/%3e%3ccircle%20cx='110'%20cy='90'%20r='8'%20fill='%232d5da1'%20stroke='%232d2d2d'%20stroke-width='3'%20/%3e%3ccircle%20cx='130'%20cy='110'%20r='8'%20fill='%232d5da1'%20stroke='%232d2d2d'%20stroke-width='3'%20/%3e%3ccircle%20cx='90'%20cy='120'%20r='8'%20fill='%232d5da1'%20stroke='%232d2d2d'%20stroke-width='3'%20/%3e%3c!--%20Cluster%202%20bounding%20shape%20--%3e%3cpath%20d='M%20240%2080%20Q%20300%2060%20320%20120%20T%20260%20180%20T%20220%20120%20Z'%20fill='%23e5e0d8'%20stroke='%232d2d2d'%20stroke-width='4'%20stroke-dasharray='8%206'%20/%3e%3ccircle%20cx='270'%20cy='110'%20r='8'%20fill='%23ff4d4d'%20stroke='%232d2d2d'%20stroke-width='3'%20/%3e%3ccircle%20cx='290'%20cy='140'%20r='8'%20fill='%23ff4d4d'%20stroke='%232d2d2d'%20stroke-width='3'%20/%3e%3ccircle%20cx='250'%20cy='150'%20r='8'%20fill='%23ff4d4d'%20stroke='%232d2d2d'%20stroke-width='3'%20/%3e%3c!--%20connecting%20lines%20linking%20to%20a%20new%20point%20--%3e%3ccircle%20cx='190'%20cy='150'%20r='7'%20fill='%23fdfbf7'%20stroke='%232d2d2d'%20stroke-width='3'%20/%3e%3cpath%20d='M%20190%20150%20L%20130%20110'%20stroke='%232d2d2d'%20stroke-width='3'%20stroke-dasharray='6%206'%20/%3e%3cpath%20d='M%20190%20150%20L%20250%20150'%20stroke='%232d2d2d'%20stroke-width='3'%20stroke-dasharray='6%206'%20/%3e%3c/svg%3e)
2D Online K-Means2D Point NK ClusteringMNIST Digit NK Clustering2D Rival-K Clustering'%20/%3e%3c!--%20graph%20--%3e%3cpath%20d='M%20220%20180%20L%20220%2060%20M%20220%20180%20L%20360%20180'%20stroke='%232d2d2d'%20stroke-width='4'%20stroke-linecap='round'%20/%3e%3c!--%20curve%20--%3e%3cpath%20d='M%20230%20170%20Q%20260%2080%20350%2070'%20stroke='%23ff4d4d'%20stroke-width='5'%20fill='none'%20stroke-linecap='round'%20/%3e%3c/svg%3e)
MNIST with Gradient Norm
Sheaf-ADMM MNIST
10-Digit Addition Grokking
Needle SAN%20--%3e%3c!--%20Col%201%20--%3e%3crect%20x='80'%20y='70'%20width='30'%20height='30'%20fill='%232d5da1'%20rx='4'%20stroke='%232d2d2d'%20stroke-width='3'%20transform='rotate(-2%2095%2085)'%20/%3e%3crect%20x='80'%20y='105'%20width='30'%20height='30'%20fill='%23fdfbf7'%20rx='4'%20stroke='%232d2d2d'%20stroke-width='3'%20transform='rotate(1%2095%20120)'%20/%3e%3crect%20x='80'%20y='140'%20width='30'%20height='30'%20fill='%23ff4d4d'%20rx='4'%20stroke='%232d2d2d'%20stroke-width='3'%20transform='rotate(-1%2095%20155)'%20/%3e%3c!--%20Arrow%20--%3e%3cpath%20d='M%20125%20120%20Q%20135%20115%20145%20120'%20stroke='%232d2d2d'%20stroke-width='3'%20fill='none'%20stroke-linecap='round'%20/%3e%3cpath%20d='M%20140%20115%20L%20145%20120%20L%20140%20125'%20stroke='%232d2d2d'%20stroke-width='3'%20fill='none'%20stroke-linecap='round'%20stroke-linejoin='round'%20/%3e%3c!--%20Col%202%20--%3e%3crect%20x='160'%20y='70'%20width='30'%20height='30'%20fill='%23ff4d4d'%20rx='4'%20stroke='%232d2d2d'%20stroke-width='3'%20transform='rotate(2%20175%2085)'%20/%3e%3crect%20x='160'%20y='105'%20width='30'%20height='30'%20fill='%232d5da1'%20rx='4'%20stroke='%232d2d2d'%20stroke-width='3'%20transform='rotate(-1%20175%20120)'%20/%3e%3crect%20x='160'%20y='140'%20width='30'%20height='30'%20fill='%232d5da1'%20rx='4'%20stroke='%232d2d2d'%20stroke-width='3'%20transform='rotate(2%20175%20155)'%20/%3e%3c!--%20Arrow%20--%3e%3cpath%20d='M%20205%20120%20Q%20215%20125%20225%20120'%20stroke='%232d2d2d'%20stroke-width='3'%20fill='none'%20stroke-linecap='round'%20/%3e%3cpath%20d='M%20220%20115%20L%20225%20120%20L%20220%20125'%20stroke='%232d2d2d'%20stroke-width='3'%20fill='none'%20stroke-linecap='round'%20stroke-linejoin='round'%20/%3e%3c!--%20Col%203%20--%3e%3crect%20x='240'%20y='70'%20width='30'%20height='30'%20fill='%232d5da1'%20rx='4'%20stroke='%232d2d2d'%20stroke-width='3'%20transform='rotate(-2%20255%2085)'%20/%3e%3crect%20x='240'%20y='105'%20width='30'%20height='30'%20fill='%23ff4d4d'%20rx='4'%20stroke='%232d2d2d'%20stroke-width='3'%20transform='rotate(1%20255%20120)'%20/%3e%3crect%20x='240'%20y='140'%20width='30'%20height='30'%20fill='%23fdfbf7'%20rx='4'%20stroke='%232d2d2d'%20stroke-width='3'%20transform='rotate(-2%20255%20155)'%20/%3e%3c!--%20Network%20connection%20representation%20lines%20--%3e%3cpath%20d='M%20100%2085%20L%20175%20120'%20stroke='%232d2d2d'%20stroke-width='2'%20stroke-dasharray='4%204'%20opacity='0.3'%20z-index='-1'%20/%3e%3cpath%20d='M%20175%20120%20L%20255%20155'%20stroke='%232d2d2d'%20stroke-width='2'%20stroke-dasharray='4%204'%20opacity='0.3'%20z-index='-1'%20/%3e%3c/svg%3e)
Linear Systems%20--%3e%3ccircle%20cx='120'%20cy='80'%20r='16'%20fill='%23fff'%20stroke='%232d2d2d'%20stroke-width='6'%20/%3e%3ccircle%20cx='200'%20cy='80'%20r='16'%20fill='%23fff'%20stroke='%232d2d2d'%20stroke-width='6'%20/%3e%3ccircle%20cx='280'%20cy='80'%20r='16'%20fill='%23fff'%20stroke='%232d2d2d'%20stroke-width='6'%20/%3e%3c!--%20Bottom%20nodes%20(visible)%20--%3e%3ccircle%20cx='80'%20cy='160'%20r='12'%20fill='%23fff'%20stroke='%232d2d2d'%20stroke-width='6'%20/%3e%3ccircle%20cx='140'%20cy='160'%20r='12'%20fill='%23fff'%20stroke='%232d2d2d'%20stroke-width='6'%20/%3e%3ccircle%20cx='200'%20cy='160'%20r='12'%20fill='%23fff'%20stroke='%232d2d2d'%20stroke-width='6'%20/%3e%3ccircle%20cx='260'%20cy='160'%20r='12'%20fill='%23fff'%20stroke='%232d2d2d'%20stroke-width='6'%20/%3e%3ccircle%20cx='320'%20cy='160'%20r='12'%20fill='%23fff'%20stroke='%232d2d2d'%20stroke-width='6'%20/%3e%3c!--%20Highlight%20nodes%20--%3e%3ccircle%20cx='200'%20cy='80'%20r='10'%20fill='%2310b981'%20/%3e%3ccircle%20cx='280'%20cy='80'%20r='10'%20fill='%2310b981'%20/%3e%3ccircle%20cx='140'%20cy='160'%20r='6'%20fill='%2310b981'%20/%3e%3ccircle%20cx='200'%20cy='160'%20r='6'%20fill='%2310b981'%20/%3e%3ccircle%20cx='260'%20cy='160'%20r='6'%20fill='%2310b981'%20/%3e%3ccircle%20cx='320'%20cy='160'%20r='6'%20fill='%2310b981'%20/%3e%3c/svg%3e)
Dense Associative MemoryAutoencoder Visualization— coming soon
Gradient Descent Playground— coming soon
Research notes
Longer write-ups of experiments, with the code and recorded data behind them.