Switching to containerd from docker causes intermittent pod networking connection refused

I have noticed log entries like these seem to happen a lot of the time networking stops:

Jun 19 15:01:37 yorkie k3s: time="2024-06-19T15:01:37Z" level=info msg="COMPACT compactRev=11484 targetCompactRev=12070 currentRev=13070"
Jun 19 15:01:37 yorkie k3s: time="2024-06-19T15:01:37Z" level=info msg="COMPACT deleted 310 rows from 586 revisions in 11.367146ms - compacted to 12070/13070"
Jun 19 15:01:37 yorkie k3s: time="2024-06-19T15:01:37Z" level=info msg="COMPACT revision 12070 has already been compacted"