F tables:
The easiest way of all -- if you can -- is to use a statistics package or other program to give you the critical value. So for example, in R, we can do this:
qf(.95,5,6744)
[1] 2.215425
(but you can as easily calculate an exact p-value for your F).
Usually F tables come with an "infinity" degrees of freedom at the end of the table,
but a few don't. If you have a really large d.f. (for example, 6744 is really large), you can use the infinity ($\infty$) entry in its place.
So you might have tables for $\nu_1=5$ that give 120 df and $\infty$ df:
... 5 ...
⁞
120 2.2899
∞ 2.2141
The $\infty$ d.f. row there will work for any really large $\nu_2$ (denominator d.f.). If we use that we have 2.2141 instead of the exact 2.2154 but that's not too bad.
If you don't have an infinity degrees of freedom entry, you can work one out from a chi-square table, using the critical value for the numerator d.f. divided by those d.f.
So for example, for a $F_{5,\infty}$ critical value, take a $\chi^2_5$ critical value and divide by $5$. The 5% critical value for a $\chi^2_5$ is $11.0705$. If we divide by $5$ that's $2.2141$ which is the $\infty$ row from the table above.
If your degrees of freedom may be a bit too small to use the "infinity" entry (but still a lot bigger than 120 or whatever your table goes up to) you can use inverse interpolation between the highest finite d.f. and the infinity entry. Let's say we want to calculate a critical value for $F_{5, 674}$ d.f.
F df 120/df
------ ---- -------
2.2899 120 1
C 674 0.17804
2.2141 ∞ 0
Then we compute the unknown critical value, $C$ as
$C \approx 2.2141 + (2.2899-2.2141) \times (0.17804-0)/(1-0) \approx 2.2276$
(The exact value is $2.2274$, so that works pretty well.)
More details on interpolation and inverse interpolation are given at that linked post.
Chi-squared tables:
If your chi-squared d.f. are really large you can use normal tables to get an approximation.
For large d.f. $\nu$ the chi-squared distribution is approximately normal with mean $\nu$ and variance $2\nu$. To get the upper 5% value, take the one-tailed 5% critical value for
a standard normal ($1.645$) and multiply by $\sqrt{2\nu}$ and add $\nu$.
For example, imagine we needed an upper 5% critical value for a $\chi^2_{6744}$.
We would calculate $1.645 \times \sqrt{2 \times 6744} + 6744 \approx 6935$. The exact answer (to $5$ significant figures) is $6936.2$.
If the degrees of freedom are smaller, we can use the fact that if $X$ is $\chi^2_\nu$ then $\sqrt{2X}\dot\sim N(\sqrt{2\nu-1},1)$.
So for example, if we had $674$ d.f. we might use this approximation. The exact upper 5% critical value for a chi-square with 674 d.f. is (to 5 figures) $735.51$. With this approximation, we would calculate as follows:
Take the upper (one tailed) 5% critical value for a standard normal (1.645), add $\sqrt{2\nu-1}$, square the total and divide by 2. In this case:
$(1.645+\sqrt{2\times 674-1})^2/2 \approx 735.2$.
As we see, this is quite close.
For considerably smaller degrees of freedom, the Wilson-Hilferty transformation could be used -- it works well down to only a few degrees of freedom -- but the tables should cover that. This approximation is that $(\frac{X}{\nu})^{\frac13}\dot\sim N(1-\frac{2}{9\nu},\frac{2}{9\nu})$.