那些遇到过的问题

标签: compss

无法运行COMPS应用程序.ClassNotFoundException的

我正在学习COMPS.到目前为止,一切都运行良好,但我只执行了手册中给出的示例.

现在我想运行自己的测试应用程序,我无法让它工作.我一定错过了什么,但我看不出我做错了什么.

我的应用程序称为App,并且具有主类App,以及另一个名为AppItf的类中的接口.当我尝试使用runco​​mpss运行它时:

runco​​mpss -d --classpath = $ PWD/App.jar App

我收到以下消息:

使用项目文件的默认位置:/opt/COMPSs/Runtime/scripts/user/../../configuration/xml/projects/project.xml使用资源文件的默认位置:/ opt/COMPSs/Runtime/scripts/user /../../configuration/xml/resources/resources.xml

-----------------执行App --------------------------

[Loader] - 加载或执行应用程序时出错.Sun.reflect.DeativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)的java.lang.reflect.InvocationTargetException at java.lang.reflect.Method.invoke(Method.java:606)位于integratedtoolkit.loader.ITAppLoader.load(ITAppLoader.java:54)的integratedtoolkit.loader.ITAppLoader.main(ITAppLoader.java:84)引起:java .lang.ClassNotFoundException:java.net.URLClassLoader $ 1.run(URLClassLoader.java:366)的javaI.URLClassLoader $ 1.run(URLClassLoader.java:355)java.security.AccessController.doPrivileged(Native Method)的AppItf java.net.URLClassLoader.findClass(URLClassLoader.java:354)at java.lang.ClassLoader.loadClass(ClassLoader.java:425)at at sun.misc.Launcher $ AppClassLoader.loadClass(Launcher.java:308)at java. lang.ClassLoader.loadClass(ClassLoader.java:358)在integratedtoolkit.loader.CustomLoader.loadClass(CustomLoader.java :56)at java.lang.Class.forName0(Native Method)at java.lang.Class.forName(Class.java:195)at integratedtoolkit.loader.total.ITAppModifier.modify(ITAppModifier.java:46)...还有6个

运行应用程序出错

有人可以帮我找到我做错的事吗？

先感谢您!

java hpc distributed-computing compss

Vic*_*ton
2016 08-03
8
推荐指数
1
解决办法
70
查看次数

具有COMPS的共享磁盘

我有一个在不同节点之间有共享磁盘的集群.

如何配置COMP superscalar以考虑此共享磁盘以避免文件传输？

java hpc distributed-computing compss

Jor*_*que
2016 08-03
6
推荐指数
1
解决办法
43
查看次数

COMPSs Monitor不显示任何应用程序

我正在使用COMPS运行COMPSs示例应用程序手册中显示的Increment应用程序.我添加了-m标志以启用监视功能:

$ runcompss -m --debug increment.Increment 5 1 2 3
Run Code Online (Sandbox Code Playgroud)

应用程序正常运行并完成(std输出/错误中没有显示错误,并且.COMPSs文件夹中的runtime.log没有任何堆栈跟踪).

我还启动了运行以下命令的COMPSs Monitor服务(我也添加了它的输出)

$ /etc/init.d/compss-monitor start
* Starting COMPSs Monitor
* Checking JAVA Installation...
   Success
* Checking IT_HOME...
WARNING: IT_HOME not defined. Trying default location /opt/COMPSs/
   Success
* Checking IT_MONITOR...
     IT_MONITOR=/root/.COMPSs/
   Success
* Checking COMPSs Monitor Port...
Warning: COMPSs_MONITOR_PORT not defined.
  Loading from configuration file.
      COMPSs_MONITOR_PORT=8080
   Success
* Checking COMPSs Monitor Timeout...
Warning: COMPSs_MONITOR_TIMEOUT not defined.
  Loading from configuration file.
      COMPSs_MONITOR_TIMEOUT=20000
   Success
* Configuring COMPSs Monitor …
Run Code Online (Sandbox Code Playgroud)

java hpc distributed-computing compss

Cri*_*tes
2016 08-03
6
推荐指数
1
解决办法
92
查看次数

C COMPS执行失败的所有作业

我已经从http://www.bsc.es/computer-sciences/grid-computing/comp-superscalar/downloads-and-documentation下载了COMPS 1.4和一些测试程序,我正在尝试测试它们.Java执行很顺利; 但是,我对C有问题.

我目前正在尝试执行Simple.自述文件声明我只需要两个命令:

buidapp simple

runcompss --lang=c master/simple 1
Run Code Online (Sandbox Code Playgroud)

应用程序构建正常,但使用此命令执行时,我收到以下错误:

[ERRMGR]  -  WARNING: Job 1 for running task 1 on worker localhost has failed; resubmitting task to the same worker.

[ERRMGR]  -  WARNING: Task 1 execution on worker localhost has failed; rescheduling task execution. (changing worker)

[ERRMGR]  -  WARNING: No task could be scheduled to any of the available resources.
                      This could end up blocking COMPSs. Will check it again in 20 seconds.
                      Possible causes: 
                          -Network problems: …
Run Code Online (Sandbox Code Playgroud)

c c++ hpc distributed-computing compss

Adr*_*.P.
2016 08-03
6
推荐指数
1
解决办法
51
查看次数

在COMPS中定义的任务中找不到文件

我用COMP Superscalar实现了一个应用程序,我的任务失败了.查看标准错误文件(job1_NEW.err)文件,我得到了一个File Not Found异常,但该文件存在于我的计算机中.

知道什么可能是错误吗？

编辑:添加了资源和项目文件

resources.xml中

          <Resource Name="172.16.8.2">
               <Capabilities>
                        <Host>
                                <TaskCount>0</TaskCount>
                                <Queue>short</Queue>
                                <Queue/>
                        </Host>
                        <Processor>
                                <Architecture>x86_64</Architecture>
                                <Speed>3.0</Speed>
                                <CoreCount>4</CoreCount>
                        </Processor>
                        <OS>
                                <OSType>Linux</OSType>
                                <MaxProcessesPerUser>32</MaxProcessesPerUser>
                        </OS>
                        <StorageElement>
                                <Size>8</Size>
                        </StorageElement>
                        <Memory>
                                <PhysicalSize>4</PhysicalSize>
                                <VirtualSize>8</VirtualSize>

                        </Memory>
                        <ApplicationSoftware>
                                <Software>Java</Software>
                        </ApplicationSoftware>
                        <Service/>
                        <VO/>
                        <Cluster/>
                        <FileSystem/>
                        <NetworkAdaptor/>
                        <JobPolicy/>
                        <AccessControlPolicy/>
                </Capabilities>
                <Requirements/>
                <Adaptors>
                    <Adaptor name="integratedtoolkit.gat.master.GATAdaptor">
                        <BrokerAdaptor>sshtrilead</BrokerAdaptor>
                    </Adaptor>
                </Adaptors>
        </Resource>
Run Code Online (Sandbox Code Playgroud)

project.xml中

 <Worker Name="172.16.8.2">
    <InstallDir>/opt/COMPSs/Runtime/scripts/system/</InstallDir>
    <WorkingDir>/home/user/test/wdir/</WorkingDir>
    <AppDir>/home/user/test/java/matmul/jar/</AppDir>
    <User>user</User>
  </Worker>
Run Code Online (Sandbox Code Playgroud)

接口文件中的方法声明

@Method(declaringClass = "matmul.files.MatmulImpl")
        void multiplyAccumulative(
                @Parameter(direction = Direction.INOUT) String file1,
                @Parameter() String file2,
                @Parameter() String file3,
                @Parameter() int bsize
        );
Run Code Online (Sandbox Code Playgroud)

java hpc distributed-computing compss

Jor*_*que
2016 08-03
5
推荐指数
1
解决办法
48
查看次数

COMPS - 节点已填充错误

提交COMPS应用程序后,我收到以下错误消息,并且未执行该应用程序.

MPI_CMD=mpirun -timestamp-output -n 1 -H s00r0
/apps/COMPSs/1.3/Runtime/scripts/user/runcompss
--project=/tmp/1668183.tmpdir/project_1458303603.xml
--resources=/tmp/1668183.tmpdir/resources_1458303603.xml
--uuid=2ed20e6a-9f02-49ff-a71c-e071ce35dacc
/apps/FILESPACE/pycompssfile arg1 arg2 : -n 1 -H s00r0
/apps/COMPSs/1.3/Runtime/scripts/system/adaptors/nio/persistent_worker_starter.sh
/apps/INTEL/mkl/lib/intel64 null
/home/myhome/kmeans_python/src/ true
/tmp/1668183.tmpdir 4 5 5 s00r0-ib0 43001 43000 true 1
/apps/COMPSs/1.3/Runtime/scripts/system/2ed20e6a-9f02-49ff-a71c-e071ce35dacc : -n 1 -H s00r0
/apps/COMPSs/1.3/Runtime/scripts/system/adaptors/nio/persistent_worker_starter.sh
/apps/INTEL/mkl/lib/intel64 null
/home/myhome/kmeans_python/src/ true
/tmp/1668183.tmpdir 4 5 5 s00r0-ib0 43001 43000 true 2
/apps/COMPSs/1.3/Runtime/scripts/system/2ed20e6a-9f02-49ff-a71c-e071ce35dacc

--------------------------------------------------------------------------
All nodes which are allocated for this job are already filled.
--------------------------------------------------------------------------
Run Code Online (Sandbox Code Playgroud)

我正在使用COMPS 1.3.

为什么会这样？

java mpi compss pycompss

J. *_*ero
2016 08-03
5
推荐指数
1
解决办法
81
查看次数

COMPS中的去同步跟踪

我使用COMPS 1.4生成了执行的痕迹.我注意到一些具有数据依赖关系的任务在tracefile中重叠.这不应该是不可能的.我还检查了依赖图,它们似乎是正确的.

我按照以下说明安装了COMPS:

/sf/answers/2699774941/

我可以做些什么来同步跟踪？我应该尝试手动同步不同机器的时钟吗？

trace synchronization hpc distributed-computing compss

COM*_*lar
2017 05-23
5
推荐指数
1
解决办法
42
查看次数

在群集中安装(py)COMPS时,Autoreconf失败

我尝试使用Supercomputers的安装脚本在Cluster系统上安装pyCOMPSs(v1.4).该脚本终止时出现以下错误:

libtool: link: ranlib .libs/libcbindings.a
libtool: link: ( cd ".libs" && rm -f "libcbindings.la" && ln -s
"../libcbindings.la" "libcbindings.la" )
make[1]: Entering directory
`/home/xxx/repos/pycompss/COMPSs/Bindings/c/src/bindinglib'
  /usr/bin/mkdir -p
'/home/cramonco/svn/compss/framework/trunk/builders/specs/deb/compss-c-binding/tmp/opt/COMPSs/Bindings/c/lib'
/usr/bin/mkdir: cannot create directory ‘/home/cramonco’: Permission denied
make[1]: *** [install-libLTLIBRARIES] Error 1
make[1]: Leaving directory
`/home/xxx/xxx/repos/pycompss/COMPSs/Bindings/c/src/bindinglib'
make: *** [install-am] Error 2

BindingLib Installation failed, please check errors above!
Run Code Online (Sandbox Code Playgroud)

python java distributed-computing compss pycompss

use*_*308
2016 08-03
5
推荐指数
1
解决办法
48
查看次数

PyCOMPSs应用程序中的奇怪错误:没有找到最后"y"的脚本

我试图运行版本1.4的示例pyCOMPSs应用程序之一,我收到以下错误,表示没有找到最终"y"的python脚本.你知道错误是什么吗？

xxx:~/xxx_xx/python/increment> runcompss --lang=python increment.py 3 1 2 3 
Using default location for project file:

 /opt/COMPSs/Runtime/scripts/user/../../configuration/xml/projects/project.xml
Using default location for resources file: /opt/COMPSs/Runtime/scripts/user/../../configuration/xml/resources/resources.xml

----------------- Executing increment.py --------------------------

WARNING: IT Properties file is null. Setting default values
[(0)    API]  -  Deploying COMPSs Runtime v1.4 (build 20160725-0937.r2315)
[(2)    API]  -  Starting COMPSs Runtime v1.4 (build 20160725-0937.r2315)
Traceback (most recent call last):
  File "/opt/COMPSs/Runtime/scripts/user/../../../Bindings/python/pycompss/runtime/launch.py", line 85, in <module>
    execfile(app_path)    # MAIN EXECUTION
  File "increment.py", line 92, in <module>
    @task(filePath = FILE_INOUT)
  File "/opt/COMPSs/Bindings/python/pycompss/api/task.py", …
Run Code Online (Sandbox Code Playgroud)

python hpc distributed-computing compss pycompss

use*_*308
2016 08-03
4
推荐指数
1
解决办法
29
查看次数

COMPS应用程序被阻止

执行手册(http://compss.bsc.es/releases/compss/latest/docs/COMPSs_User_Manual_App_Exec.pdf)中给出的示例应用程序增量时,运行时将被阻止,并且终端中不会显示任何错误消息.

OUTPUT: 

$ runcompss increment.Increment 3 1 2 3
Using default location for project file: /opt/COMPSs/Runtime/configuration/xml/projects/project.xml
Using default location for resources file: /opt/COMPSs/Runtime/configuration/xml/resources/resources.xml

----------------- Executing increment.Increment --------------------------

WARNING: IT Properties file is null. Setting default values
[   API]  -  Deploying COMPSs Runtime v1.3 
[   API]  -  Starting COMPSs Runtime v1.3
Initial counter values:
- Counter1 value is 1
- Counter2 value is 2
- Counter3 value is 3
Run Code Online (Sandbox Code Playgroud)

我怎么知道什么阻止了我的申请？

先感谢您

编辑: 检查$ HOME/.COMPSs/increment*/runtime.log所有任务似乎都被阻止:

grep "Blocked" runtime.log …
Run Code Online (Sandbox Code Playgroud)

java hpc distributed-computing compss

Cri*_*tes
2016 08-03
3
推荐指数
1
解决办法
104
查看次数

修复COMPS跟踪错误:线程X evtset X的PAPI_read失败(papi_hwc.c:*)

我试图在激活跟踪系统(extrae)的情况下运行COMPS.我第一次遇到安装问题但我解决了这个问题:

如何修复libpapi.so.*运行时不能打开共享对象文件(py)带跟踪的COMPS？

但是,现在我正面临一个新的PAPI问题.COMPS运行时似乎已正确加载但Extrae报告此错误:

Extrae: Error! Hardware counter PAPI_L3_TCM (0x80000008) cannot be added in set 1 (thread 0)
Extrae: Error! Hardware counter PAPI_FP_INS (0x80000034) cannot be added in set 1 (thread 0)
Extrae: Error! Hardware counter PAPI_SR_INS (0x80000036) cannot be added in set 2 (thread 0)
Extrae: Error! Hardware counter PAPI_BR_UCN (0x8000002a) cannot be added in set 2 (thread 0)
Extrae: Error! Hardware counter PAPI_BR_CN  (0x8000002b) cannot be added in set 2 (thread 0)
Extrae: Error! Hardware counter PAPI_VEC_SP (0x80000069) cannot …
Run Code Online (Sandbox Code Playgroud)

python distributed-computing papi compss pycompss

Cri*_*tes
2017 05-23
3
推荐指数
1
解决办法
65
查看次数

标签 统计

compss ×11

distributed-computing ×10

hpc ×8

java ×7

pycompss ×4

python ×3

c ×1

c++ ×1

mpi ×1

papi ×1

synchronization ×1

trace ×1