I guess you'll need privileged SCC or roll an own SELinux policy, since it'll finally be SELinux that stops you from accessing that device.
You can use the privileged SCC to run as SELinux contect SPC, and then drop all capabilities and change your UID using the security context. That's not amazing, but I'm reasonably sure it should work.