Aimo,
Spelling of both your great-grandfather's family name and his second name suggest to me that he was Belorussian, Ukrainian or even Russian. This is nothing surprising. Poland until the II World War was very multi-ethnic country, and both Belorussians and Ukrainians provided a very high percentage of Polish population. On the other hand since the end of XVII century, the whole XIX century up to beginning of XX century (till 1918) Poland was occupied by Prussia, Austria and Russia. There were a few uprises during XIX and Russia kept large military forces in Poland. Because of all the wars majority of archives were lost. The other thing is that Polish borders has change significantly, so your ancestor origin might be from the territory or current Belorussia and/or Ukraine or even Lithuania. In these countries majority of archives were also lost or are not really available. Therefore, it might be very difficult for you to find any information on your ancestors. Still, good luck.
Jurek