25.0.0

Common components and the framework

Added support for openEuler 24.03 LTS SP1.

Porting Advisor

• Added support for GCC for openEuler 3.0.1 and BiSheng Compiler 4.2.0 in source code porting.
• Optimized the style of porting reports.
• Added the total number of scanned files to source code porting reports.

System Migration

• Added the Redis and Nginx automatic packaging scripts and related guides.
• Added command lines to support source code porting analysis of Maven projects. Added command lines to analyze Kunpeng-incompatible options for a Maven project and generate a detailed report to provide guidance for migrating the Maven project.
• Added the automatic conversion capability for Java application packages. The conversion scope includes hardware architecture conversion and database migration conversion. The conversion process is traceable and can be rolled back.
• Added cross-architecture Docker image migration analysis in the Python technology stack scenario, where Python images, Python libraries, and CUDA libraries can be scanned and related suggestions are provided.
• Added the compatibility assessment capability for migrating from MySQL to DM8.

• Allows users to configure personal target component packages to complete a system migration.
• Added new supported Nginx versions to the migration path: 1.11.*, 1.13.*, 1.14.*, 1.15.*, 1.25.*, and 1.26.*
• Expanded the version scope of migrating from Tomcat to Tomcat in System Migration, with 5.5.*, 6.0.*, 7.0.*, 8.0.*, and 9.0.* added.
• Extended the Oracle migration path for System Migration: from Oracle 19.* to DM8 and from Oracle to Kingbase.
• Added support for .NET source code SQL scanning in System Migration.

Affinity Analyzer

• Included C/C++ precision analysis in the calculation precision analysis function.
• Added the following functions in calculation precision analysis (for Fortran): incremental compilation, multi-process parallel log printing, code instrumentation based on input parameters of functions, instrumentation for ifort and ifx compilation projects, identification of precision-related compilation options, rectification tips, and optimized instrumentation for incompatible mods.
• Added the K-NET data collection and analysis tool to offer functions of compatibility analysis and sequence diagram printing.
• Added the ability to retry tasks in the Affinity Analyzer.
• Optimized the style of affinity analysis reports.
• Vectorization check is accelerated.
• Added customized compilation commands to byte alignment check.
• Optimized the command output for BC file generation.
• Simplified reports for data race check, with the functions of saving historical reports, and filtering out duplicate items of thread information and memory address information.

Development Assistant

Extended the compiler version range in dictionary management. The BiSheng Compiler version range is updated to 2.1.0 to 4.2.0 and the GCC version range is updated to 4.8.5 to 12.3.1.

Compiler and Debugger

• Deployment of GCC for openEuler 3.0.1, BiSheng Compiler 4.2.0, and BiSheng JDK 17.0.13+12.
• Added command lines for the HPC Debugger.

System Profiler

• Added the dwarf option for hotspot function analysis and miss event analysis.
• Enhanced automatic tuning in the CLI with system parameter selection and resumable tuning.

Java Profiler

• Password-free deployment of the target environment.
• GaussDB included in JDBC analysis.
• Added the ability to analyze Java processes on a Kubernetes compute node without needing to log in to the node.
• Added the capability of analyzing ZGC logs.

System Diagnosis

• Added the function of unit test generation for Spring Boot projects in UTgen.
• Added the JVM Jitter Detection command line tool.
  • SDK mode and command line mode: collects JIT de-optimization metrics and collects de-optimization data, and detects code cache metrics.
  • CLI mode: collects statistics on JIT de-optimization.

DTS2024121703496

[CC] [Tuning with DevKit] After a Donau tenant runs the dsub command to submit a DevKit container job, the job is suspended and affects the information collection for the container job.

Minor

Add the --ipc parameter when using Singularity containers to execute MPI analysis tasks.

DevKit MPI analysis tasks executed in Singularity containers.

In a containerized environment, the Cross Memory Attach (CMA) mechanism is used in the Unified Communication X (UCX) context of Open MPI (especially HUCX and HMPI). Due to the CMA incompatibility issue, the internal communication within the hpctool node fails. (From the perspective of users, the application is started on one node. However, technically, the MPI sorting occurs in different temporary file systems in the container. That means that the MPI sorting occurs on different nodes.)

DTS2024122618065

[Kunpeng] [DevKit] When a user submits a large-rank debugging process using the DonauKit in VS Code, the UI is suspended and no result is returned.

Minor

Run dsub -N 550 -nl [node_name] mpirun -x PATH -x LD_LIBRARY_PATH -mca btl ^vader,tcp,uct,openib -mca pml ucx to perform the debugging.

Users submit a large-rank debugging process using the DonauKit in VS Code.

If the rank size is too large, too many sockets are being connected simultaneously. Consequently, the connection requests are rejected. The idle sockets that have completed data sending and receiving need to be released to reduce the number of concurrent socket connections.

DTS2025010211916

[System Diagnosis] [Memory usage] [Backend] The collection task has continued for three and a half hours when 120-second memory usage statistics of an HPC application are being collected using BPF Compiler Collection (BCC). The application path is /opt/test/usr/ompi/bin/mpirun, and the application parameter is --allow-run-as-root -np 2 -H xx.xx.xx.xx:28 -H xx.xx.xx.xx:28 -wdir /opt/test/lammps/RUN/airebo/ /opt/test/lammps/src/lmp_mpi -in in.tension -v model_name data.

Minor

Execute more than one process to collect data in multiple groups.

Long-time memory diagnosis in the BCC environment.

The C library is invoked for Python to implement the BCC function. If the data volume is large, the invoking takes a long time.

DTS2024123106544

[Source code porting] Due to a defect in the preprocessing module, no message is displayed by default when the source code porting function is used in the first-layer macro definition, while a message is displayed when this function is used in the second-layer macro definition.

Minor

Add branch judgment. Use the x86 macro in the source code porting scenario.

Source code porting and byte alignment.

During preprocessing, the macro definition for the current compiler architecture is obtained from the system. The macro definition on x86 is different from that on Kunpeng. During processing, the __x86_64__ macro is used on x86 and the code in the __x86_64__ macro branch is added to the system macro list; however, the __x86_64__ macro definition cannot be obtained on the AArch64 platform because the macros in the __x86_64__ macro branch are not added to the AArch64 platform macro list. Therefore, no prompt is displayed when these macros are used.

DTS2024112909019

[Database] [Static check] [MySQL] During a static check with the DevKit, it takes a long time to check a large file (more than 60 MB) and no result is generated even after 10 days.

Minor

Add the exit mechanism and maximum timeout interval.

Static check of large files in the DevKit.

It takes a long time to parse the dependency logic in the Static Value-Flow Analysis Framework (SVF).

DTS2024112908199

[Database] [Static check] [MySQL] During a static check with the DevKit, the swap partition does not take effect, and an error message is displayed indicating that the memory space is insufficient.

Minor

Add the swapfree field resolution.

Static check of swap partitions in the DevKit.

Before the static check, the DevKit does not check swap partitions.

DTS2025030427370

When debugging an HPC application that uses 2048 ranks, execute the MPI_INIT function and then the debugging command. The error message "All ranks has exited" is displayed even though the application running has not completed.

Minor

When starting a debugging task, specify the -e parameter to add the environment variable export PMIX_MCA_gds=^ds21.

The added environment variable is valid only for the current debugging task. It is transferred through the debugger parameter and becomes invalid after it is executed, incurring no impact on any other task. The tool usage does not affect the MPI program compilation and running or the running of existing tasks in the cluster.

Coordinate with other departments, including the HPC Development Dept, to secure test resources and complete the full test by April 11, 2025.