Karma's Firefox testing doesn't work with the SNAP version of Firefox. Which is the version you get in Ubuntu 22.04 even when you install via apt-get. The SNAP version is sandboxed, so Firefox can't create its temp files, so it reports a failure to load the profile.
Currently the recommended solution from Karma is to not use the SNAP version. Doh.