I think I'm the opposite. I find the speech easier than the narrative. I think this is because I see all the scenes happening several times over before I sit down to write them. I've heard all of the characters speaking and arguing, so I just have to copy that down. Describing the surroundings is more like work.
Colin M