GMB/Maps Help -- Business Ranks on Maps for "Blue Widgets" but not "Blue Widgets Denver"

For a bunch of keywords--let's say "blue widgets"--there is a google map in the SERP, and my business ranks in the top 3 in the map results, as well as somewhere on page 1 in the search results.

But if I add the name of the city to the search query, let's say "blue widgets Denver", my business is no longer in the top 3 on the map results--I have to click "view all" and go all the way to page 2 in Google Maps to find it, even though the site still ranks 1st page in the search results part of the SERP.

To simplify:

• "blue widgets"
  • ranks #1-3 on Google Maps
  • ranks #1-10 on Google Search
• "blue widgets Denver"
  • ranks >#20 on Google Maps <---- why??
  • ranks #1-10 on Google Search

What is going on here? How can I make my business rank in Google Maps for both "blue widgets" and "blue widgets Denver"? I have GMB set up properly as far as I can tell, with all my business information, products, services, etc. My website copy seems on point too, it mentions the city throughout the copy, and it ranks when including the city name in search queries.