Years back, I visited the Haskell Free Library and Opera House in the village of Derby Line, Vermont. Derby Line is located right at the border of Canada, with the aforementioned building actually straddling the border itself, a deliberate design decision made back in 1904. The entrance is on the American side, but Canadians have long been able to access it without needing to pass through customs. It has never been an issue.
You will likely not be shocked to learn that this friendly arrangement has been ended by the Trump administration.

