can not buid bistro

[shaohongxu]

I have some progress on building Bistro. I can run travis_docker_build.sh to build but the following error blocked the building process. I found the TMultiplexedProtocol.cpp is an apache thrift file and it is not contained in fbthrift project. And I still can not find a successful build in Travis.

Would you like to tell me how to fix the problem so I can move forward. many thanks!

make[4]: *** No rule to make target 'protocol/TMultiplexedProtocol.cpp', needeby 'protocol/TMultiplexedProtocol.lo'. Stop.
make[4]: *** Waiting for unfinished jobs....
make[4]: Leaving directory '/home/fbthrift/thrift/lib/cpp'
Makefile:1287: recipe for target 'all-recursive' failed
make[3]: Leaving directory '/home/fbthrift/thrift/lib/cpp'
make[3]: *** [all-recursive] Error 1
Makefile:416: recipe for target 'all-recursive' failed
make[2]: Leaving directory '/home/fbthrift/thrift/lib'
make[2]: *** [all-recursive] Error 1
Makefile:498: recipe for target 'all-recursive' failed
make[1]: Leaving directory '/home/fbthrift/thrift'
make[1]: *** [all-recursive] Error 1

[ghost]

This docker build worked for me:

cd bistro
export os_image=ubuntu:16.04
export gcc_version=5
make_parallelism=2 ./build/fbcode_builder/travis_docker_build.sh

It creates a docker image, as you can see:
$ docker images
REPOSITORY TAG IMAGE ID CREATED SIZE
05a86e19c6cc 2 minutes ago 2.8 GB
Reference: https://docs.docker.com/engine/reference/commandline/build/

Non-docker build
Also this non-docker build might make gdb easier (at least for me). It installs fbthrift, etc. to /usr/local. It is extracted from docker build above; you might need to adjust PYTHONPATH near the end:

#!/bin/bash
# Install packages and initial git clone and build of dependencies.
# This install deps to /usr/local.
# Debian (ubuntu:16.04)

sudo apt-get update

sudo apt-get install -yq autoconf-archive bison build-essential cmake curl flex git gperf joe libboost-all-dev libcap-dev libdouble-conversion-dev libevent-dev libgflags-dev libgoogle-glog-dev libkrb5-dev libnuma-dev libsasl2-dev libsnappy-dev libsqlite3-dev libssl-dev libtool netcat-openbsd pkg-config unzip wget gcc-5 g++-5

sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-5 40 --slave /usr/bin/g++ g++ /usr/bin/g++-5

sudo update-alternatives --config gcc

### Diagnostics ###

# Builder DockerFBCodeBuilder(gcc_version='5', facebook/bistro:local_repo_dir='/home/jhwang/src/bistro/build/fbcode_builder/../..', projects_dir=u'/home', facebook/zstd:git_hash=ShellQuoted(u'$(git describe --abbrev=0 --tags)'), prefix=u'/home/install', os_image='ubuntu:16.04', user=u'nobody', docker_context_dir=u'/tmp/docker-context-DhadcF', wangle/wangle:cmake_defines={u'BUILD_TESTS': u'OFF'}, make_parallelism=2, no1msd/mstch:git_hash=ShellQuoted(u'$(git describe --abbrev=0 --tags)'))
hostname
cat /etc/issue
g++ --version || echo g++ not installed

basedir=$HOME/src

### Check out facebook/folly, workdir folly ###

cd "$basedir"
git clone https://github.com/facebook/folly
cd folly/folly

### Build and install folly/folly ###

autoreconf -ivf
LDFLAGS="$LDFLAGS -L/usr/local/lib -Wl,-rpath=/usr/local/lib" CFLAGS="$CFLAGS -I/usr/local/include" CPPFLAGS="$CPPFLAGS -I/usr/local/include" PY_PREFIX=/usr/local ./configure --prefix=/usr/local
make -j 2
sudo make install

### Check out facebook/wangle, workdir wangle ###

cd "$basedir"
git clone https://github.com/facebook/wangle
cd wangle/wangle
[ -f build ] || mkdir build
cd build

### Build and install wangle/wangle ###

cmake -DCMAKE_INSTALL_PREFIX=/usr/local -DBUILD_SHARED_LIBS=ON -DBUILD_TESTS=OFF ..
make -j 2
sudo make install

### Check out facebook/proxygen, workdir proxygen ###

cd "$basedir"
git clone https://github.com/facebook/proxygen
cd proxygen/proxygen

### Build and install proxygen/proxygen ###

autoreconf -ivf
LDFLAGS="$LDFLAGS -L/usr/local/lib -Wl,-rpath=/usr/local/lib" CFLAGS="$CFLAGS -I/usr/local/include" CPPFLAGS="$CPPFLAGS -I/usr/local/include" PY_PREFIX=/usr/local ./configure --prefix=/usr/local
make -j 2
sudo make install

### Check out facebook/zstd, workdir . ###

cd "$basedir"
git clone https://github.com/facebook/zstd
cd zstd
git checkout $(git describe --abbrev=0 --tags)

### Build and install zstd ###

make -j 2 PREFIX=/usr/local
sudo make install PREFIX=/usr/local

### Check out no1msd/mstch, workdir . ###

cd "$basedir"
git clone https://github.com/no1msd/mstch
cd mstch
git checkout $(git describe --abbrev=0 --tags)
[ -f build ] || mkdir build
cd build

### Build and install no1msd/mstch ###

cmake -DCMAKE_INSTALL_PREFIX=/usr/local -DBUILD_SHARED_LIBS=ON ..
make -j 2
sudo make install

### Check out facebook/fbthrift, workdir thrift ###

cd "$basedir"
git clone https://github.com/facebook/fbthrift
cd fbthrift/thrift

### Build and install fbthrift/thrift ###

autoreconf -ivf
LDFLAGS="$LDFLAGS -L/usr/local/lib -Wl,-rpath=/usr/local/lib" CFLAGS="$CFLAGS -I/usr/local/include" CPPFLAGS="$CPPFLAGS -I/usr/local/include" PY_PREFIX=/usr/local ./configure --prefix=/usr/local
make -j 2
sudo make install

### Build Bistro ###

cd "$basedir"
git clone https://github.com/facebook/bistro.git
cd bistro/bistro
PYTHONPATH="$PYTHONPATH:/usr/local/lib/python2.7/site-packages" ./cmake/run-cmake.sh Debug -DCMAKE_INSTALL_PREFIX=/usr/local
cd cmake/Debug
make -j 2

### Run bistro tests ###

ctest

[snarkmaster]

Thanks for sharing your experience. The builds of some of Bistro's dependencies (especially facebook/fbthrift) got broken several times over the last couple of weeks. I apologize for this. I think we fixed all the known issues at this point.

As far as the Docker-free build, the reason we have not yet provided this sort of script is that it is actually fairly tricky to make it robust to updates, rebuilds, varying versions of dependencies, etc. Docker lets the build start from a known-good state every time.

That said, if you have a clean Debian-like system, and you want to install Bistro, it's perfectly reasonable to run the commands from the appropriately generated Dockerfile. That should work.

Please feel free to reopen if you have any other questions or concerns!