Jekyll2026-03-13T23:06:56+00:00https://ionutmodo.github.io/feed.xmlionutmodoPhD student working in optimization for AI at Institute of Science and Technology (ISTA)Ionut Modoranuionut[dash]vlad[dot]modoranu[at]ista[dot]ac[dot]atNewtonian-Shampoo: Modified Newton-Schulz Adapted for Shampoo Preconditioners2025-10-16T00:00:00+00:002025-10-16T00:00:00+00:00https://ionutmodo.github.io/posts/newtonian-shampooShampoo optimizer was proposed in [1]
References:
TODO:
[] Shampoo won ML-Perf competition
[] the best optimizer in the paper Beyond Outliers
[] slow because of EVD and/or Coupled-Newton
[] explain how we adapt Newton-Schulz for -1/p power
[] provide implementation
[] show results
]]>Ionut Modoranuionut[dash]vlad[dot]modoranu[at]ista[dot]ac[dot]atBlog Post number 22013-08-14T00:00:00+00:002013-08-14T00:00:00+00:00https://ionutmodo.github.io/posts/blog-post-2This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Headings are cool
You can have many headings
Aren’t headings cool?
]]>Ionut Modoranuionut[dash]vlad[dot]modoranu[at]ista[dot]ac[dot]atBlog Post number 12012-08-14T00:00:00+00:002012-08-14T00:00:00+00:00https://ionutmodo.github.io/posts/blog-post-1This is a sample blog post.
