"It's a very exciting discovery, because the last mammoth find (in the canton of Zug) was 50 years ago," said Renata Huber of the canton's heritage and archaeological department.
During the construction of an office building in the town of Rotkreuz late last month, a heavy digger emerged from the ground lifting what appeared to be a large tusk, Huber said.
Local government specialists were immediately called in, and several other bones were later discovered, but not enough to reconstruct a full mammoth, she added.
"It's not clear if this is all one animal," Huber said, noting that the find was not as significant as those previously unearthed in Zurich, which enabled specialists to recreate an entire carcass.
Experts will now try to date the remains, and specialists will stay at the construction site until they are satisfied that there are no further bones to be uncovered.
The discovery is unlikely to shed any new light on the type of prehistoric species that once lived on what is now Swiss land, but Huber said the significance of the find should not be understated.
"For an archaeologist, this is a once in a lifetime thing."