We always put the blame on characters like Lady Rochford, Cromwell, Cardinal Wolsey or the Duke of Norfolk, often forgetting that it was Henry who always had the last word and who commanded the others!
About that George Boleyn, supposed son of the Viscount Rochford and Jane Parker, I would say that he was an illegitimate child rather than a legitimate child... If not, as his father's only child, he would have probably been favoured by Elizabeth, and he seems to be very unknown. It doesn't seem also that Jane had any children, so I'm inclined to believe he was a bastard of George, Anne's brother.