Hi Aurelien Jarno <aurelien@aurel32.net> writes: > On 2016-12-30 10:06, Emilio Pozuelo Monfort wrote: >> On 29/12/16 20:56, Gaudenz Steinlin wrote: > > The problem is indeed a memory issue, not that the buildd doesn't have > enough memory, but just that you can allocate only 2GB per process on a > 32-bit MIPS machine. As Emilio said, the above GCC flag should help to > reduce the memory usage by running the garbage collector more often. > > However gcc 6.3 seems to have improved the situation a bit, so I given > back the packages, I hope they will build now. Otherwise I have a patch > ready to change the GCC defaults. That said GCC upstream consider it's a > bug in the garbage collector [1], so that should be fixed instead and the > patch should be considered as a temporary workaround. > Aurelien thanks for taking care and resheduling the build. Unfortunately this did not solve the problem. But setting the following variables solves the virtual memory issue for me on the mipsel porterbox (eller): export DEB_CFLAGS_MAINT_APPEND= --param ggc-min-expand=10 -O1 export DEB_CXXFLAGS_MAINT_APPEND= --param ggc-min-expand=10 -O1 export DEB_CFLAGS_MAINT_STRIP= -O2 export DEB_CXXFLAGS_MAINT_STRIP= -O2 But unfortunately the build fails at another point. See the log below. I'm not sure how to fix this. If I understand it right these atomic operations are just not supported on mipsel[1]. Or is there a way to make them work? Gaudenz [1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=56296 libtool: link: g++ -I/usr/include/nss -I/usr/include/nspr -Wall -Wtype-limits -Wignored-qualifiers -Winit-self -Wpointer-arith -Werror=format-security -fno-strict-aliasing -fsigned-char -rdynamic -ftemplate-depth-1024 -Wnon-virtual-dtor -Wno-invalid-offsetof -O2 -g -pipe -Wall -Wp,-U_FORTIFY_SOURCE -Wp,-D_FORTIFY_SOURCE=2 -fexceptions --param=ssp-buffer-size=4 -fPIE -fstack-protector-strong -Wstrict-null-sentinel -I../src/gmock/include -I../src/gmock/include -I../src/gmock/gtest/include -I../src/gmock/gtest/include -g -fdebug-prefix-map=/home/gaudenz/ceph=. -fstack-protector-strong -Wformat -Werror=format-security --param ggc-min-expand=10 -O1 -pie -Wl,-z -Wl,relro -Wl,-z -Wl,now -Wl,-z -Wl,relro -Wl,-z -Wl,now -o .libs/ceph_test_cls_rgw test/cls_rgw/ceph_test_cls_rgw-test_cls_rgw.o /usr/lib/mipsel-linux-gnu/libatomic_ops.a -Wl,--as-needed ./.libs/librados.so ./.libs/libcls_rgw_client.a ../src/gmock/lib/.libs/libgmock_main.a ../src/gmock/lib/.libs/libgmock.a ../src/gmock/gtest/lib/.libs/libgtest.a ./.libs/libglobal.a -lpthread -lm ./.libs/libradostest.a ./.libs/libcommon.a -ldl -lboost_thread -lboost_random -lrt -lblkid -luuid -lnss3 -lnssutil3 -lsmime3 -lssl3 -lplds4 -lplc4 -lnspr4 -lboost_iostreams -lboost_system -pthread rocksdb/librocksdb.a(memtable.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(memtable.o):/usr/include/c++/6/bits/atomic_base.h:396: more undefined references to `__atomic_load_8' follow rocksdb/librocksdb.a(memtable.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(memtable.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(memtable.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(env_posix.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(env_posix.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(env_posix.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(file_reader_writer.o): In function `std::__atomic_base<long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(db_impl.o):/usr/include/c++/6/bits/atomic_base.h:396: more undefined references to `__atomic_load_8' follow rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(db_impl.o):/usr/include/c++/6/bits/atomic_base.h:396: more undefined references to `__atomic_load_8' follow rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::fetch_add(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(db_impl.o):/usr/include/c++/6/bits/atomic_base.h:396: more undefined references to `__atomic_load_8' follow rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::fetch_add(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' rocksdb/librocksdb.a(db_impl.o):/usr/include/c++/6/bits/atomic_base.h:514: more undefined references to `__atomic_fetch_add_8' follow rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(db_impl.o): In function `rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool)': ./src/rocksdb/db/db_impl.cc:1028: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::fetch_add(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(db_impl.o): In function `rocksdb::DBImpl::WriteImpl(rocksdb::WriteOptions const&, rocksdb::WriteBatch*, rocksdb::WriteCallback*)': ./src/rocksdb/db/db_impl.cc:4184: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(db_impl.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(flush_job.o): In function `std::__atomic_base<unsigned long long>::fetch_add(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' rocksdb/librocksdb.a(flush_job.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(forward_iterator.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(forward_iterator.o):/usr/include/c++/6/bits/atomic_base.h:396: more undefined references to `__atomic_load_8' follow rocksdb/librocksdb.a(version_set.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(version_set.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(version_set.o): In function `rocksdb::VersionSet::LogAndApply(rocksdb::ColumnFamilyData*, rocksdb::MutableCFOptions const&, rocksdb::VersionEdit*, rocksdb::InstrumentedMutex*, rocksdb::Directory*, bool, rocksdb::ColumnFamilyOptions const*)': ./src/rocksdb/db/version_set.cc:2093: undefined reference to `__atomic_fetch_add_8' rocksdb/librocksdb.a(version_set.o): In function `std::__atomic_base<unsigned long long>::fetch_add(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' rocksdb/librocksdb.a(version_set.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(version_set.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(version_set.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(version_set.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(version_set.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(thread_status_updater.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(thread_status_updater.o):/usr/include/c++/6/bits/atomic_base.h:374: more undefined references to `__atomic_store_8' follow rocksdb/librocksdb.a(thread_status_updater.o): In function `std::__atomic_base<unsigned long long>::fetch_add(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' rocksdb/librocksdb.a(thread_status_updater.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(thread_status_updater.o):/usr/include/c++/6/bits/atomic_base.h:396: more undefined references to `__atomic_load_8' follow rocksdb/librocksdb.a(thread_status_updater.o): In function `std::__atomic_base<unsigned long long>::store(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(thread_status_updater.o):/usr/include/c++/6/bits/atomic_base.h:374: more undefined references to `__atomic_store_8' follow rocksdb/librocksdb.a(column_family.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(column_family.o): In function `std::__atomic_base<unsigned long long>::operator++()': /usr/include/c++/6/bits/atomic_base.h:296: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:296: undefined reference to `__atomic_fetch_add_8' rocksdb/librocksdb.a(column_family.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(compaction_job.o): In function `std::__atomic_base<unsigned long long>::fetch_add(unsigned long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' /usr/include/c++/6/bits/atomic_base.h:514: undefined reference to `__atomic_fetch_add_8' rocksdb/librocksdb.a(compaction_job.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(transaction_log_impl.o): In function `std::__atomic_base<unsigned long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' rocksdb/librocksdb.a(transaction_log_impl.o):/usr/include/c++/6/bits/atomic_base.h:396: more undefined references to `__atomic_load_8' follow rocksdb/librocksdb.a(rate_limiter.o): In function `std::__atomic_base<long long>::store(long long, std::memory_order)': /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' /usr/include/c++/6/bits/atomic_base.h:374: undefined reference to `__atomic_store_8' rocksdb/librocksdb.a(rate_limiter.o): In function `std::__atomic_base<long long>::load(std::memory_order) const': /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' /usr/include/c++/6/bits/atomic_base.h:396: undefined reference to `__atomic_load_8' collect2: error: ld returned 1 exit status Makefile:15928: recipe for target 'ceph_objectstore_bench' failed make[4]: *** [ceph_objectstore_bench] Error 1 make[4]: *** Waiting for unfinished jobs.... make[4]: Leaving directory '/home/gaudenz/ceph/src' Makefile:30865: recipe for target 'all-recursive' failed make[3]: *** [all-recursive] Error 1 make[3]: Leaving directory '/home/gaudenz/ceph/src' Makefile:12571: recipe for target 'all' failed make[2]: *** [all] Error 2 make[2]: Leaving directory '/home/gaudenz/ceph/src' Makefile:703: recipe for target 'all-recursive' failed make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory '/home/gaudenz/ceph' dh_auto_build: make -j4 returned exit code 2 debian/rules:62: recipe for target 'build' failed make: *** [build] Error 2 dpkg-buildpackage: error: debian/rules build gave error exit status 2 -- PGP: 836E 4F81 EFBB ADA7 0852 79BF A97A 7702 BAF9 1EF5
Attachment:
signature.asc
Description: PGP signature