[Installation Error] Installation Error on MacOS - pynini

[ai-nikolai]

Installing on MacOS does not seem to work.

To reproduce:

conda install -c conda-forge pynini
pip3 install WeTextProcessing==1.0.4.1

The resulting error is:

      ld: library 'fstfarscript' not found
      clang++: error: linker command failed with exit code 1 (use -v to see invocation)
      error: command '/usr/bin/clang++' failed with exit code 1

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pynini
Failed to build pynini
error: failed-wheel-build-for-install

(I am building pynini using conda-forge as per official installation instructions).

Related issue: #292

[pengzhendong]

install pynini with pip

pip install pynini

[ai-nikolai]

@pengzhendong thank you for your answer.

This leads to the different errors on MacOS, see here:
kylebgorman/pynini#95

specifically it has to do with the openfst library.

[pengzhendong]

Oh, I uninstall pynini and now I can't install it back...

[ai-nikolai]

Which version did you have before? Do you know by any chance?

[pengzhendong]

2.1.6.post1

[pengzhendong]

brew install openfst==1.8.4
export CPLUS_INCLUDE_PATH="/opt/homebrew/include:$CPLUS_INCLUDE_PATH"
export LIBRARY_PATH="/opt/homebrew/lib:$LIBRARY_PATH"
uv pip install pynini==2.1.7

It works for me.

[ai-nikolai]

When I run the above I get the following error:

      /opt/homebrew/Caskroom/miniconda/base/envs/env_isochronometer/include/fst/compat.h:204:13: note:
      'StrJoin' declared here
        204 | std::string StrJoin(const std::vector<S> &elements, std::string_view delim) {
            |             ^
      In file included from extensions/_pynini.cpp:1251:
      In file included from extensions/stringmapscript.h:31:
      extensions/stringmap.h:230:26: error: no member named 'StringJoin' in namespace 'fst'; did you mean
      'StrJoin'?
        230 |                  << fst::StringJoin(line, "\t") << "`";
            |                     ~~~~~^~~~~~~~~~
            |                          StrJoin
      /opt/homebrew/Caskroom/miniconda/base/envs/env_isochronometer/include/fst/compat.h:204:13: note:
      'StrJoin' declared here
        204 | std::string StrJoin(const std::vector<S> &elements, std::string_view delim) {
            |             ^
      2 errors generated.
      error: command '/usr/bin/clang++' failed with exit code 1

      hint: This usually indicates a problem with the package or the build environment.
  help: `pynini` (v2.1.6) was included because `wetextprocessing` (v1.0.4.1) depends on `pynini`

What is your python version, other libraries?

(And just to confirm, are you using arm Mac?)

[ai-nikolai]

@pengzhendong I guess the issue is that openfst 1.8.3 is hard to install, do you know how to install openfst 1.8.3 on Mac?

[pengzhendong]

brew install openfst==1.8.4

[pengzhendong]

Maybe you should uninstall your openfst /opt/homebrew/Caskroom/miniconda/base/envs/env_isochronometer/include/fst installed by conda first.

[ai-nikolai]

Hi @pengzhendong,

I have tried all combinations (including inside and outside of conda environments).

When I try installing only the brew version of openfst (1.8.4) this causes an error:

     /opt/homebrew/include/fst/compat.h:197:13: note: 'StrJoin' declared here
        197 | std::string StrJoin(const std::vector<S> &elements, std::string_view delim) {
            |             ^
      In file included from extensions/_pynini.cpp:1251:
      In file included from extensions/stringmapscript.h:31:
      extensions/stringmap.h:230:26: error: no member named 'StringJoin' in namespace 'fst'; did you mean
      'StrJoin'?
        230 |                  << fst::StringJoin(line, "\t") << "`";
            |                     ~~~~~^~~~~~~~~~
            |                          StrJoin
      /opt/homebrew/include/fst/compat.h:197:13: note: 'StrJoin' declared here
        197 | std::string StrJoin(const std::vector<S> &elements, std::string_view delim) {
            |             ^
      2 errors generated.
      error: command '/usr/bin/clang++' failed with exit code 1

      hint: This usually indicates a problem with the package or the build environment.

As can be seen in the issue reported here:
kylebgorman/pynini#92
kylebgorman/pynini#95

[pengzhendong]

@ai-nikolai Which pynini version did you install?

StringJoin has changed to StrJoin in version 2.1.7: kylebgorman/pynini@27ce190#diff-3a65e079150026320f21adcc58920e4f3a2ca766cf781dfc14add5b1177e3d6eL230