Consider physics selection when building the buffer.