Installing and Simulating on Linux

1. Copy the EMA3D zipped archive to the Linux machine on which you would like the program to execute. If using a different machine to host a license server, the archive should also be copied there.

2. Run the following command to unzip the archive:

   tar -zxvf EMA3D_LINUX_ANSYSv<version>.tar.gz (e.g., tar -zxvf EMA3D_LINUX_ANSYSv6.2.6.tar.gz)

3. The directory should now contain the following items:

   1. ansys/

   2. binaries/

   3. lib/

   4. installer_ansys.sh

   5. l_mpi-rt_2018.4.274.tgz

4. If using a separate license server machine, only the ansys directory is needed on the license server machine, while the remaining files are needed on the machine used to simulate EMA3D. Steps 4, 5, and 6 in this section are only required on the machines used to run EMA3D. The license server setup will be covered in the next section.

5. Execute the installer with the following command (must be run as root to access files in the /opt/ directory):

   sudo ./installer_ansys.sh

6. Follow the on-screen prompts to install the necessary libraries, Intel MPI, and set environmental variables. For more information on the prompts see: Additional Information

7. For the changes to take effect, the shell must be restarted, or the following command can be run:

   source /etc/profile

1. Set the ANSYSLMD_LICENSE_FILE variable with the command:

   export ANSYSLMD_LICENSE_FILE=/path/to/your/license/ansys.lic

2. If the same machine is being used to host the license server and run EMA3D:

   1. In the directory with the Ansys license manager, find the file named “start_ansysli”. Make sure it has executable permissions.

      Execute the following command in the terminal to start the Ansys License Manager:

      ./start_anysli

   2. In the same directory, there should be a sub-directory called “linx64”. Inside here you will find a file called “lmgrd”. Again, ensure that the file can be executed.

      Execute the following command in the terminal to start the license server:

      ./lmgrd

3. If a different machine is being used to host the license server than to run EMA3D:

   On the machine used to run EMA3D:

   1. The ansyslmd.ini file must be modified so that the server addresses are correct. Modify the file to include the port and IP address of the machine hosting the license, as below:

      SERVER=1055@<ip or hostname> (e.g., 1055@192.158.1.38 or 1055@hostname)

      ANSYSLI_SERVERS=2325@<ip or hostname> (e.g., 2325@192.158.1.38 or 2325@hostname)

   On the license server machine:

   1. The firewall rules may need to be modified to allow the license server ports to be opened.

   2. The Ansys License manager randomly assigns a port for the Vendor daemon, but this is not ideal. Instead, assign a static port number in the license file. In the license file sent by Ansys, use a text editor to modify the vendor line to add the bolded portion below:

      VENDOR ansyslmd PORT=<new port number> (e.g., VENDOR ansyslmd PORT=1056)

   3. CentOS uses firewalld, so the commands below apply to distros that use this package.

      sudo firewall-cmd --add-port=<new port number>/tcp --permanent (e.g., sudo firewall-cmd --add-port=1056/tcp --permanent)

      The default ports for Ansys are 1055 and 2325. Use the above command to add firewall exceptions for the two default ports and the static port you specified in the license file.

      To test that the specified ports are open, enter the following command on the machine that will run EMA3D:

      telnet <ip address> <port number>.

      If the port is open, then the command window will become blank.

   4. Now that the ports are open, you should be able to start the license server. In the directory with the Ansys license manager, find the file named “start_ansysli”. You will need to make sure it has executable permissions.

      Execute the following command in the terminal to start the Ansys License Manager:

      ./start_ansysli

   5. In the same directory, there should be a sub-directory called “linx64”. Inside here you will find a file called “lmgrd”. Again, ensure that the file can be executed.

      Execute the following command in the terminal to start the license server:

      ./lmgrd

Installation Prompts

• Package Selection

  • The first prompt provides a list of packages for the user to install.

  • The only essential package is the “lsb” (Linux Standard Base) package, which provides necessary functionality for the solver and Intel MPI.

  • “cifs-utils” is needed for mounting a shared network drive.

  • “openssh” is useful for accessing the machine from a different computer.

  • “net-tools” is useful for finding information about the machine and opening firewall ports for licensing.

• Intel MPI

  • If the correct version of MPI is already installed in the expected location the installation process will continue to the next step.

  • Otherwise, the user will be asked to install Intel MPI. While we suggest using the version that we provide, but there is an option to use a current installation.

  • Selecting “y” will guide the user through the Intel installation steps for MPI.

  • Selecting “n” will prompt the user for the installation directory of the current MPI installation and then the version number, or it will exit the installation if no installation exists.

  • It is possible that the installation cannot be detected on our end, but that it can be detected when the MPI installer is launched. If that is the case (which will be indicated in the MPI installer), then select the option to repair the current installation.

• Licensing Location

  • There will be a check to allow the user to specify a location to place the libe3mhlow.so file. This file is used for the license checkout of the solver.

  • The specified location will be appended to the LD_LIBRARY_PATH variable.

  • If “default” is entered, the file will be placed in the opt/ directory and that location will be appended to the path above.

• Environment Variables

  • Environment variables necessary for the execution of EMA3D are written to a script called “ema3d-environment-config” located in “/etc/profile.d”.

  • This file will be run when any user logs in, which allows for the loading of these variables while still being a self-contained configuration.

  • This file will also be immediately run during installation.

  • It is considered best practice to put application specific setups in a file like this.

• Newer Linux builds require input files to use Linux-style line breaks and fail when there are Windows-style line breaks. The easiest workaround is to install on Linux the utility dos2unix and then run the following command on the simulation directory before launching the simulation:

  dos2unix *

  To install on a RedHat flavor (RedHat, CentOS) use the command:

  sudo yum install dos2unix

• To run an EMA3D simulation, navigate to the location of the emin file, then execute:

  mpiexec -np <num_cores> ema3d <name_of_emin_file>.emin (e.g., mpiexec -np 8 ema3d test.emin)