This contribution is focused on a description of implementation details for solver related to the slope stability benchmarks in 3D. Such problems are formulated by the standard elastoplastic models containing the Mohr-Coulomb yield criterion and by the limit analysis of collapse states. The implicit Euler method and higher order finite elements are used for discretization. The discretized problem is solved by non-smooth Newton-like methods in combination with incremental methods of limit load analysis. In this standard approach, we propose several innovative techniques. Firstly, we use recently developed sub-differential based constitutive solution schemes. Such an approach is suitable for non-smooth yield criteria, and leads better return-mapping algorithms. For example, a priori decision criteria for each return-type or simplified construction of consistent tangent operators are applied. The parallel codes are developed in MATLAB using Parallel Computing Toolbox. For parallel implementation of linear systems, we use the TFETI domain decomposition method. It is a non-overlapping method where the Lagrange multipliers are used to enforce continuity on the subdomain interfaces and satisfaction of the Dirichlet boundary conditions.