A new and distinct cultivar of Verbena plant named ‘Duempstraw’, characterized by its compact, mounding and cascading plant habit; freely branching habit; freely flowering habit; large red-colored flowers that are held above and beyond the foliage in mounded umbels; and resistance to Powdery Mildew.