Problem with Esq.RowCount and esq.SkipRowCount

I'm trying to get a query to return rows 51-100 by using esq (serverside). I thought this would do the trick : 

 var userconnection = UserConnection.Current;
 var esq = new EntitySchemaQuery(userconnection.EntitySchemaManager, "Contact");

 esq.AddColumn("Name");
 esq.AddColumn("Email");

 // Skip the first 50 rows
 esq.SkipRowCount = 50;

 // Return the next 50 rows
 esq.RowCount = 50;

 var entities = esq.GetEntityCollection(userconnection)

I assumed the SkipRowCount would skip the first 50 records, and the RowCountt would then return the next 50 records in the table. However, i get 0 records as result. Does anyone see what I'm missing here?