Why weren't the diseases brought by vikings as destructive as those brought by colonial powers?

Since there is so little in the way of primary source material concerning the Vikings and their arrival/stay in what is now the USA and/or Canada, it is really impossible to say with any accuracy that the Vikings didn't bring, and spread, disease among the native populations they encountered.