I've always wanted to take a trip north of the border, so I recently picked up a travel guide to Montréal and Québec City, because if you are going to go to Canada, shouldn't you go to the part with the oldest buildings, the different language, and the exciting separatist movement? Of course you should!
Montréal is very appealing as an urban and kind of cosmopolitan getaway, but I think in my ideal trip I'd spend a day or two there at the start and end of the visit, and spend the rest of the time in Québec City and the little towns nearby. If you don't ski and aren't particularly interested in shopping, it seems the big things to do in Québec City are stroll around the old streets looking at old buildings, sit down and look at the river, or sit in a café, restaurant, or bar and eat and drink tasty things. These happen to be some of my favorite activities ever!
This Frommer's guide was a great introduction to the region -- it was nicely written with clear maps, gave just enough detail without being overwhelming, and included a pretty detailed section on the history of the region, which is something I really like to have in a travel guide.
Also, the national dish in Québec is the amazing sounding poutine. I seriously can't think of any better reason to go to Canada and I wish I had a big bowl of gravy and cheese curd covered french fries in front of me right now.