Just try to do it all in a single fluid motion.
Kick the dumbell up with your knees as you lay down, pinch shoulder blades, chest out and just shoot up with the arms and contract chest.
I'm just guessing here, but maybe try with resistance bands on a barbell or bands alone to help. You don't want to tear a rotator cuff, so go lighter maybe till you're comfortable.