5,323
edits
PyTorch: Difference between revisions
→Reducing GPU memory usage
| Line 96: | Line 96: | ||
This can result in a minor performance hit which PyTorch will warn you about if you repeatedly use a contiguous tensor with a channels last tensor. | This can result in a minor performance hit which PyTorch will warn you about if you repeatedly use a contiguous tensor with a channels last tensor. | ||
To address this, call [https://pytorch.org/docs/stable/tensors.html#torch.Tensor.contiguous <code>contiguous</code>] on the tensor with the new memory format. | To address this, call [https://pytorch.org/docs/stable/tensors.html#torch.Tensor.contiguous <code>contiguous</code>] on the tensor with the new memory format. | ||
;During inference | |||
* Use `model.eval()` | |||
* Use `with torch.no_grad():` | |||
===Float16=== | ===Float16=== | ||