update apache arrow to v16

[ChronosMasterOfAllTime]

Description

Resolves #1101

Checklist

• Created tests which fail without the change (if possible)
• Extended the README / documentation, if necessary

[github-actions]

All contributors have signed the CLA ✍️ ✅
_{Posted by the CLA Assistant Lite bot.}

[ChronosMasterOfAllTime]

I have read the CLA Document and I hereby sign the CLA

[ChronosMasterOfAllTime]

recheck

[sfc-gh-dszmolka]

hi and thanks for your contribution! can we maybe revisit this when Arrow v16 is actually released and use the official release ? It's not available yet.

[sfc-gh-dszmolka]

@ChronosMasterOfAllTime Arrow v16 looks to be released now, can you please modify your PR to have the official released v16.0.0 ?

[ChronosMasterOfAllTime]

@ChronosMasterOfAllTime Arrow v16 looks to be released now, can you please modify your PR to have the official released v16.0.0 ?

@sfc-gh-dszmolka done!

[sfc-gh-pfus]

Fantastic! Let's give it a few days to see if there is no critical update on Arrow side. Thanks a lot @ChronosMasterOfAllTime !

[sfc-gh-pfus]

It turns out, that Arrow 16 requires newer version of Go (1.21). We still support 1.19 so we have to put it on hold.

[Yifeng-Sigma]

It turns out, that Arrow 16 requires newer version of Go (1.21). We still support 1.19 so we have to put it on hold.

do we have a rough timeline of when we will do this upgrade?

[sfc-gh-pfus]

We (with @sfc-gh-sthyagaraj , our PM) are still working on all aspects (including legal) of deprecating old language versions. I can't make the promises, but I've been pushing this issue for a long time...

[sfc-gh-pfus]

Hi @ChronosMasterOfAllTime ! We dropped support for 1.20 which was a blocker for this one. Would you like to continue working on it (rebase and solve conflicts)?

[sfc-gh-pfus]

Hi @ChronosMasterOfAllTime ! Pinging again - do you want to continue working on upgrading Arrow or you want me to finish it?

[ChronosMasterOfAllTime]

Sure I can do a quick rebase @sfc-gh-pfus

[ChronosMasterOfAllTime]

FYI: https://arrow.apache.org/blog/2024/10/23/arrow-go-18.0.0-release/ for when you bump to go 1.22

[sfc-gh-pfus]

PR merged, thank you @ChronosMasterOfAllTime !