install_deps.sh fails with llvm not found (however llvm3.4 is compiled earlier) #44540

New Issue

Piotr Arłukowicz · 2015-04-28T21:12:14+02:00

Piotr Arłukowicz commented

2015-04-28 21:12:14 +02:00

System Information
Linux Mint 17.1, updated, Tesla2070

Blender Version
Broken: last master origin

Short description of error
0. Fresh Linux Mint 17.1 install.

Updated system.
Installed git and build-essential
Cloned blender with git clone http://git.blender.org/blender.git
From ~/bin/blender-git/blender run build_files/build_environment/install_deps.sh with options: --with-all -s ~/bin/blender-git/depssrc -i ~/bin/blender-git/deps
After the compilation of few components, script failed with error describe below.

[...]
HEAD is now at 22ee5ea Workaround to make OSl compilable with older OIIO library
ILMBASE_HOME=/home/piotao/bin/blender-git/deps/openexr

The C compiler identification is GNU 4.8.2
The CXX compiler identification is GNU 4.8.2
Check for working C compiler: /usr/bin/cc
Check for working C compiler: /usr/bin/cc -- works
Detecting C compiler ABI info
Detecting C compiler ABI info - done
Check for working CXX compiler: /usr/bin/c++
Check for working CXX compiler: /usr/bin/c++ -- works
Detecting CXX compiler ABI info
Detecting CXX compiler ABI info - done
Project source dir = /home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11
Project build dir = /home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build
Using gcc 4.8 as the compiler
CMAKE_CXX_COMPILER is /usr/bin/c++
CMAKE_CXX_COMPILER_ID is GNU
platform = linux64
OPENIMAGEIOHOME = /home/piotao/bin/blender-git/deps/oiio
#define ILMBASE_VERSION_STRING "2.2.0"
Looking for include file pthread.h
Looking for include file pthread.h - found
Looking for pthread_create
Looking for pthread_create - not found
Looking for pthread_create in pthreads
Looking for pthread_create in pthreads - not found
Looking for pthread_create in pthread
Looking for pthread_create in pthread - found
Found Threads: TRUE
Found IlmBase: /home/piotao/bin/blender-git/deps/openexr/include
BOOST_ROOT
Boost version: 1.54.0
Found the following Boost libraries:
filesystem
regex
system
thread
Found ZLIB: /usr/lib/x86_64-linux-gnu/libz.so (found version "1.2.8")
Partio not found
LLVM version =
LLVM dir =
CMake Error at src/cmake/externalpackages.cmake:229 (message):

LLVM not found.

Call Stack (most recent call first):

CMakeLists.txt:200 (include)

Configuring incomplete, errors occurred!
See also "/home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build/CMakeFiles/CMakeOutput.log".
See also "/home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build/CMakeFiles/CMakeError.log".
make: *** No targets specified and no makefile found. Stop.
make: *** No rule to make target `clean'. Stop.
ERROR! OpenShadingLanguage-1.5.11 failed to compile, exiting

HOWEVER!
There is LLVM already compiled in:
/home/piotao/bin/blender-git/deps:

pio@maon|~/bin/blender-git/blender> /bin/ls -gG ../deps
razem 24
lrwxrwxrwx 1 42 kwi 28 19:27 llvm -> /home/piotao/bin/blender-git/deps/llvm-3.4
drwxr-xr-x 6 4096 kwi 28 19:27 llvm-3.4
drwxr-xr-x 4 4096 kwi 28 19:10 numpy-1.8.1
lrwxrwxrwx 1 44 kwi 28 19:11 ocio -> /home/piotao/bin/blender-git/deps/ocio-1.0.9
drwxr-xr-x 5 4096 kwi 28 19:11 ocio-1.0.9
lrwxrwxrwx 1 45 kwi 28 19:14 oiio -> /home/piotao/bin/blender-git/deps/oiio-1.4.16
drwxr-xr-x 5 4096 kwi 28 19:14 oiio-1.4.16
lrwxrwxrwx 1 47 kwi 28 19:12 openexr -> /home/piotao/bin/blender-git/deps/openexr-2.2.0
drwxr-xr-x 6 4096 kwi 28 19:12 openexr-2.2.0
lrwxrwxrwx 1 46 kwi 28 19:06 python-3.4 -> /home/piotao/bin/blender-git/deps/python-3.4.0
drwxr-xr-x 6 4096 kwi 28 19:06 python-3.4.0

exact LLVM dir:
pio@maon|~/bin/blender-git/blender> tree -d ../deps/llvm
../deps/llvm
├── bin
├── include
│ ├── clang
│ │ ├── Analysis
│ │ │ ├── Analyses
│ │ │ ├── DomainSpecific
│ │ │ ├── FlowSensitive
│ │ │ └── Support
│ │ ├── ARCMigrate
│ │ ├── AST
│ │ ├── ASTMatchers
│ │ │ └── Dynamic
│ │ ├── Basic
│ │ ├── CodeGen
│ │ ├── Config
│ │ ├── Driver
│ │ ├── Edit
│ │ ├── Format
│ │ ├── Frontend
│ │ ├── FrontendTool
│ │ ├── IDE
│ │ ├── Index
│ │ ├── Lex
│ │ ├── Parse
│ │ ├── Rewrite
│ │ │ ├── Core
│ │ │ └── Frontend
│ │ ├── Sema
│ │ ├── Serialization
│ │ ├── StaticAnalyzer
│ │ │ ├── Checkers
│ │ │ ├── Core
│ │ │ │ ├── BugReporter
│ │ │ │ └── PathSensitive
│ │ │ └── Frontend
│ │ └── Tooling
│ ├── clang-c
│ ├── llvm
│ │ ├── ADT
│ │ ├── Analysis
│ │ ├── Assembly
│ │ ├── Bitcode
│ │ ├── CodeGen
│ │ │ └── PBQP
│ │ │ └── Heuristics
│ │ ├── Config
│ │ ├── DebugInfo
│ │ ├── ExecutionEngine
│ │ ├── IR
│ │ ├── IRReader
│ │ ├── LTO
│ │ ├── MC
│ │ │ └── MCParser
│ │ ├── Object
│ │ ├── Option
│ │ ├── Support
│ │ ├── TableGen
│ │ ├── Target
│ │ └── Transforms
│ │ ├── IPO
│ │ └── Utils
│ └── llvm-c
│ └── Transforms
├── lib
│ └── clang
│ └── 3.4
│ └── include
└── share

  ├── clang
  └── llvm
      └── cmake

71 directories

**System Information** Linux Mint 17.1, updated, Tesla2070 **Blender Version** Broken: last master origin **Short description of error** 0. Fresh Linux Mint 17.1 install. 1. Updated system. 2. Installed git and build-essential 3. Cloned blender with git clone http://git.blender.org/blender.git 4. From ~/bin/blender-git/blender run build_files/build_environment/install_deps.sh with options: --with-all -s ~/bin/blender-git/depssrc -i ~/bin/blender-git/deps 5. After the compilation of few components, script failed with error describe below. [...] HEAD is now at 22ee5ea Workaround to make OSl compilable with older OIIO library ILMBASE_HOME=/home/piotao/bin/blender-git/deps/openexr - The C compiler identification is GNU 4.8.2 - The CXX compiler identification is GNU 4.8.2 - Check for working C compiler: /usr/bin/cc - Check for working C compiler: /usr/bin/cc -- works - Detecting C compiler ABI info - Detecting C compiler ABI info - done - Check for working CXX compiler: /usr/bin/c++ - Check for working CXX compiler: /usr/bin/c++ -- works - Detecting CXX compiler ABI info - Detecting CXX compiler ABI info - done - Project source dir = /home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11 - Project build dir = /home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build - Using gcc 4.8 as the compiler - CMAKE_CXX_COMPILER is /usr/bin/c++ - CMAKE_CXX_COMPILER_ID is GNU - platform = linux64 - OPENIMAGEIOHOME = /home/piotao/bin/blender-git/deps/oiio - #define ILMBASE_VERSION_STRING "2.2.0" - Looking for include file pthread.h - Looking for include file pthread.h - found - Looking for pthread_create - Looking for pthread_create - not found - Looking for pthread_create in pthreads - Looking for pthread_create in pthreads - not found - Looking for pthread_create in pthread - Looking for pthread_create in pthread - found - Found Threads: TRUE - Found IlmBase: /home/piotao/bin/blender-git/deps/openexr/include - BOOST_ROOT - Boost version: 1.54.0 - Found the following Boost libraries: - filesystem - regex - system - thread - Found ZLIB: /usr/lib/x86_64-linux-gnu/libz.so (found version "1.2.8") - Partio not found - LLVM version = - LLVM dir = CMake Error at src/cmake/externalpackages.cmake:229 (message): ``` LLVM not found. ``` Call Stack (most recent call first): ``` CMakeLists.txt:200 (include) ``` - Configuring incomplete, errors occurred! See also "/home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build/CMakeFiles/CMakeOutput.log". See also "/home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build/CMakeFiles/CMakeError.log". make: *** No targets specified and no makefile found. Stop. make: *** No rule to make target `clean'. Stop. ERROR! OpenShadingLanguage-1.5.11 failed to compile, exiting HOWEVER! There is LLVM already compiled in: /home/piotao/bin/blender-git/deps: pio@maon|~/bin/blender-git/blender> /bin/ls -gG ../deps razem 24 lrwxrwxrwx 1 42 kwi 28 19:27 llvm -> /home/piotao/bin/blender-git/deps/llvm-3.4 drwxr-xr-x 6 4096 kwi 28 19:27 llvm-3.4 drwxr-xr-x 4 4096 kwi 28 19:10 numpy-1.8.1 lrwxrwxrwx 1 44 kwi 28 19:11 ocio -> /home/piotao/bin/blender-git/deps/ocio-1.0.9 drwxr-xr-x 5 4096 kwi 28 19:11 ocio-1.0.9 lrwxrwxrwx 1 45 kwi 28 19:14 oiio -> /home/piotao/bin/blender-git/deps/oiio-1.4.16 drwxr-xr-x 5 4096 kwi 28 19:14 oiio-1.4.16 lrwxrwxrwx 1 47 kwi 28 19:12 openexr -> /home/piotao/bin/blender-git/deps/openexr-2.2.0 drwxr-xr-x 6 4096 kwi 28 19:12 openexr-2.2.0 lrwxrwxrwx 1 46 kwi 28 19:06 python-3.4 -> /home/piotao/bin/blender-git/deps/python-3.4.0 drwxr-xr-x 6 4096 kwi 28 19:06 python-3.4.0 exact LLVM dir: pio@maon|~/bin/blender-git/blender> tree -d ../deps/llvm ../deps/llvm ├── bin ├── include │ ├── clang │ │ ├── Analysis │ │ │ ├── Analyses │ │ │ ├── DomainSpecific │ │ │ ├── FlowSensitive │ │ │ └── Support │ │ ├── ARCMigrate │ │ ├── AST │ │ ├── ASTMatchers │ │ │ └── Dynamic │ │ ├── Basic │ │ ├── CodeGen │ │ ├── Config │ │ ├── Driver │ │ ├── Edit │ │ ├── Format │ │ ├── Frontend │ │ ├── FrontendTool │ │ ├── IDE │ │ ├── Index │ │ ├── Lex │ │ ├── Parse │ │ ├── Rewrite │ │ │ ├── Core │ │ │ └── Frontend │ │ ├── Sema │ │ ├── Serialization │ │ ├── StaticAnalyzer │ │ │ ├── Checkers │ │ │ ├── Core │ │ │ │ ├── BugReporter │ │ │ │ └── PathSensitive │ │ │ └── Frontend │ │ └── Tooling │ ├── clang-c │ ├── llvm │ │ ├── ADT │ │ ├── Analysis │ │ ├── Assembly │ │ ├── Bitcode │ │ ├── CodeGen │ │ │ └── PBQP │ │ │ └── Heuristics │ │ ├── Config │ │ ├── DebugInfo │ │ ├── ExecutionEngine │ │ ├── IR │ │ ├── IRReader │ │ ├── LTO │ │ ├── MC │ │ │ └── MCParser │ │ ├── Object │ │ ├── Option │ │ ├── Support │ │ ├── TableGen │ │ ├── Target │ │ └── Transforms │ │ ├── IPO │ │ └── Utils │ └── llvm-c │ └── Transforms ├── lib │ └── clang │ └── 3.4 │ └── include └── share ``` ├── clang └── llvm └── cmake ``` 71 directories

Piotr Arłukowicz commented

2015-04-28 21:12:14 +02:00

Changed status to: 'Open'

Piotr Arłukowicz commented

2015-04-28 21:12:14 +02:00

Added subscriber: @piotao

Bastien Montagne commented

2015-04-29 10:21:46 +02:00

Added subscriber: @mont29

Bastien Montagne commented

2015-04-29 10:21:46 +02:00

You should not have to build llvm at all, mint17 is based on Ubuntu Trusty, which have llvm 3.4 packages…

Anyway, I would need the full logs of a clean install_deps.sh run to investigate this (please attach it as a file, instead of pasting it like that directly in report), as well as the two files mentionned here:

See also "/home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build/CMakeFiles/CMakeOutput.log".
See also "/home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build/CMakeFiles/CMakeError.log".

You should not have to build llvm at all, mint17 is based on Ubuntu Trusty, which have llvm 3.4 packages… Anyway, I would need the full logs of a clean install_deps.sh run to investigate this (please attach it as a file, instead of pasting it like that directly in report), as well as the two files mentionned here: > See also "/home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build/CMakeFiles/CMakeOutput.log". > See also "/home/piotao/bin/blender-git/depssrc/OpenShadingLanguage-1.5.11/build/CMakeFiles/CMakeError.log".

Piotr Arłukowicz commented

2015-04-29 21:07:15 +02:00

Dear Bastien, thank you for reply.
I'll prepare fresh install again in few days, and include required files as you requested. Sorry for inconvenience.

Also, I'm using Mint Distro, which is based on Debian, not on Ubuntu, and in standard distro there is only llvm-3.3 included as packages. However, this is still 17.1 quiana release.

cheers
pio

Dear Bastien, thank you for reply. I'll prepare fresh install again in few days, and include required files as you requested. Sorry for inconvenience. Also, I'm using Mint Distro, which is based on Debian, not on Ubuntu, and in standard distro there is only llvm-3.3 included as packages. However, this is still 17.1 quiana release. cheers pio

Bastien Montagne commented

2015-04-29 21:20:53 +02:00

Afaik, mint 17.1 is Rebecca and is based on Trusty (http:*www.linuxmint.com/download_all.php), which has llvm 3.4 in its repo (http:*packages.ubuntu.com/search?keywords=llvm&searchon=names&suite=trusty&section=all) …

Piotr Arłukowicz commented

2015-04-29 21:26:45 +02:00

So... you're right!
Here's my linux version, however:

Linux maon.* 3.11-2-amd64 #1 SMP Debian 3.11.8-1 (2013-11-13) x86_64
Last login: Wed Apr 29 20:22:16 2015 from hebron
pio@maon|~> cat /etc/lsb-release
DISTRIB_ID=LinuxMint
DISTRIB_RELEASE=1
DISTRIB_CODENAME=debian
DISTRIB_DESCRIPTION="LMDE MATE Edition"
pio@maon|~> apt-cache search llvm- dev --names-only
libghc-llvm-dev - Haskell bindings to the LLVM compiler toolkit
libghc-llvm-base-dev - low-level bindings to the LLVM compiler toolkit
libllvm-ocaml-dev - Low-Level Virtual Machine (LLVM), bindings for OCaml
llvm-dev - Low-Level Virtual Machine (LLVM), libraries and headers
libllvm-3.2-ocaml-dev - Low-Level Virtual Machine (LLVM), bindings for OCaml
llvm-3.2-dev - Low-Level Virtual Machine (LLVM), libraries and headers
libllvm-3.3-ocaml-dev - Modular compiler and toolchain technologies, OCaml bindings
llvm-3.3-dev - Modular compiler and toolchain technologies, libraries and headers
pio@maon|~>

So, it seems that my distro, based on Debian, is not the same as 17.1. Strange! I don't remember when I downloaded my install CD (maybe it was some earlier test version?), but that obviously is not the last one. Thank you, I'll check Rebecca and then the whole problem can disappear!

So... you're right! Here's my linux version, however: Linux maon.* 3.11-2-amd64 #1 SMP Debian 3.11.8-1 (2013-11-13) x86_64 Last login: Wed Apr 29 20:22:16 2015 from hebron pio@maon|~> cat /etc/lsb-release DISTRIB_ID=LinuxMint DISTRIB_RELEASE=1 DISTRIB_CODENAME=debian DISTRIB_DESCRIPTION="LMDE MATE Edition" pio@maon|~> apt-cache search llvm- dev --names-only libghc-llvm-dev - Haskell bindings to the LLVM compiler toolkit libghc-llvm-base-dev - low-level bindings to the LLVM compiler toolkit libllvm-ocaml-dev - Low-Level Virtual Machine (LLVM), bindings for OCaml llvm-dev - Low-Level Virtual Machine (LLVM), libraries and headers libllvm-3.2-ocaml-dev - Low-Level Virtual Machine (LLVM), bindings for OCaml llvm-3.2-dev - Low-Level Virtual Machine (LLVM), libraries and headers libllvm-3.3-ocaml-dev - Modular compiler and toolchain technologies, OCaml bindings llvm-3.3-dev - Modular compiler and toolchain technologies, libraries and headers pio@maon|~> So, it seems that my distro, based on Debian, is not the same as 17.1. Strange! I don't remember when I downloaded my install CD (maybe it was some earlier test version?), but that obviously is not the last one. Thank you, I'll check Rebecca and then the whole problem can disappear!

Bastien Montagne commented

2015-05-06 10:01:52 +02:00

Changed status from 'Open' to: 'Archived'

Bastien Montagne closed this issue

2015-05-06 10:01:52 +02:00

Bastien Montagne self-assigned this 2015-05-06 10:01:52 +02:00

Bastien Montagne commented

2015-05-06 10:01:52 +02:00

Eeeeh, this was still open, time to archive!