FYI, the computer may not be powered off like you think since pressing any key or even the Trackpad can cause these laptops to wake up or even power on. Connecting/disconnecting any device can do the same as well.
So the laptop being hot is not exactly surprising to me even when you think you powered it off. If the laptop is actually on, then it may be running enough apps to cause the system to be hot. After logging into your computer after one of these episodes where you thought the laptop was powered off, wait a minute or two for the logs to update, then run the following Terminal command which will show you whether the laptop was on/awake, or powered off during that time. Copy & paste this command since some spacing in the filter sectiion is critical to get the desired results (pay attention to the date & times):
pmset -g log | grep -E 'Sleep |Wake |Start |ShutdownCause |Notification '
As for the power adapter, they can sometimes get quite warm, even hot while charging the laptop. Over the years I have encountered some power adapters which seem to be hotter than others, but I rarely touch the power adapters.
You can try running the Apple Diagnostics to see if any hardware issues are detected. Only errors are useful results since a passing result is meaningless.
Did you perform the SMC Reset correctly? The process is different for the 2018-2020 T2 Macs. See the following Apple article for details:
Reset the SMC of your Mac - Apple Support
For safety and peace of mind, I agree with @MartinR to have Apple examine your laptop along with your power adapter & charging cable. While we can offer some tips, there is no way we can be sure of what is going on here since we cannot see & feel the system.