Sorry - have not run it. Don't have the rig to run a 70B at useful speeds.
I can vouch for MiniCPM5-2B (you'll have to look into the training mix for that one yourself but IIRC, it also is open source)
Sorry - have not run it. Don't have the rig to run a 70B at useful speeds.
I can vouch for MiniCPM5-2B (you'll have to look into the training mix for that one yourself but IIRC, it also is open source)