Amazon will come into your house to take your digital copies of books you paid for (e.g. when they did that with 1984). No reason to think they wouldn't take physical books after they've violated your digital sovereignty - it is only a question of if that were to ever become a viable option for them.