As cool as that is, it does end up looking confusing. Maybe some quick visual indication (possibly customized by each user) to show source of comment could help.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments