Yes you can.
3.7V is fine for the GB Pocket. You can fit it inside by removing the battery compartment (keeping the cover), and removing two larger unnecessary capacitors (they won't be needed considering the stability of the 3.7V GBASP Battery).
As for charging without a GBASP, yes, but I don't know off-hand how to make a charging circuit for it.