[removed]

It could, but doesn't have to. For temporal dimensions 4 is very often seen, so you probably wanna start with that firat, then see how it compares to 3 or 2.

Intuitively, I think 2 time points are useless. It's difficult to generalize something new from such a short relation. Intuitively, I would like to sample t, t-1, t-2 and t-4, but I'd first confirm it's better than t, t-1, t-2 and t-3.

Do you think it would be beneficial to have 365 different time points (1 each day) in my fourth dimension? I know it’s hard to say, but what do you think?

Probably not.

• I am almost certain you don't have data that would take advantage of this dimensionality or the resources to process it
• you can't accumulate so many features and remember all of them in recurrent models
• I am almost certain you don't have the hardware to house such a large transformer model that could process it
• I am almost certain you will not get a 365 day history of a sample during inference, 4 days seems more reasonable

Ok so what if I have something like 10 temporal points, assuming you I have the necessary computing power. The other dimensions are pixels (x and y) and channels (bands).

Yeah, just experiment with it. Like I said, I would start with 4. Then go higher or lower depending on your needs. I have personally not seen a temporally sensitive neural network to go beyond 6 or 8 time points. As with anything, there are tradeoffs.

Although if you have x, y and c, you will be doing 3D convolutions, not 4D. A 4D convolution on 4D data is essentially a linear layer.

Ok, that makes sense. One more thing though. According to my research, temporal points during the spring and autumn are more helpful for what I'm trying to do. However, I'm afraid that large jumps like this will confuse my model. Like it will have a hard time detecting features when time jumps like this happen. Is this a real concern?

As long as you keep the jumps the same it should be fine.