Following a string of premature reports, R&B star Keyshia Cole gave birth to a baby boy 'a little before midnight' yesterday…