We don't know.

Is there an actual fixed number of things to learn? Or can science keep going and finding new things forever?

We're clearly nowhere near any limit currently, if there is one.

But if we don't go extinct and we keep learning will we hit a limit in 10,000 years? 1,000,000 years?

No idea.