If that's from the System Window, it always shows just the stock speed that the CPU is, it doesn't show what it's currently running at
So yes tha's what you would indeed expect to see on that screen.
Mine shows like that as well on that screen (mine shows 3.5GHz, but then its an older CPU so isn't as fast) and mine is OC'd to 4.5GHz
If that's from the System Window, it always shows just the stock speed that the CPU is, it doesn't show what it's currently running at
So yes tha's what you would indeed expect to see on that screen.
If you use software such as HWmonitor, it will show you what you CPU clocks are as well as temps etc. Depending on your windows setting you may see them very low in the min section but look at the max and during heavier workload, it will show what they clock up to.
Note that if you run it while the CPU is under low load, the frequency might be quite low as it down clocks itself to save power. If you want to ramp it up, run something like Cinebench on all cores https://www.maxon.net/en/products/cinebench/