If you’re on the beta, under Taskbar settings > Taskbar behaviors, you can now select options under Show smaller taskbar ...

Microsoft is testing out resizable taskbar icons in Windows 11 that can shrink as you open more apps or stay at a smaller size for good. The new options are included in the latest Insider Preview ...