"You don't have an absolute right to own private property in Canada," said former Liberal Justice Minister David Lametti