Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The GraphSMOTE(T) results were not satisfactory #6

Open
cheng-zhimin opened this issue Nov 13, 2022 · 8 comments
Open

The GraphSMOTE(T) results were not satisfactory #6

cheng-zhimin opened this issue Nov 13, 2022 · 8 comments

Comments

@cheng-zhimin
Copy link

Hi, I'd like to restate the results of the GraphSMOTE(T) experiment, I typed in this command line:

python main.py --imbalance --no-cuda --dataset=cora --setting='recon'

The results are as follows:

ACC = 0.271, OC-ROC = 0.5000, F Score = 0.1843

I have tried many times but couldn't get the results of GraphSMOTE(T) in the paper, is there something wrong with my command line? Or is there something else wrong with my operation? Thank you.

@TianxiangZhao
Copy link
Owner

Hi, I remember that 'recon' is only used to pretrain the edge predictor and will not optimize the classifier. You can save the pretrained model and run with settings like 'newG_cls' following the Readme.
To test the result without pretraining, you can try directly run with settings like 'recon_newG' without loadling any checkpoints.

@cheng-zhimin
Copy link
Author

cheng-zhimin commented Nov 13, 2022 via email

@TianxiangZhao
Copy link
Owner

Hi, 非常抱歉这么晚才回复。在没有load checkpoint的情况下,recon_newG对应的是GraphSMOTE(O), newG_cls对应的是GraphSMOTE(T). 如果用recon预训练了并且load checkpoint情况下,他们分别对应(O_pre)和(T_pre)。

希望能帮到您

@cheng-zhimin
Copy link
Author

cheng-zhimin commented Feb 23, 2023 via email

@TianxiangZhao
Copy link
Owner

抱歉我现在只有原始的Twitter数据集了. Node embedding 文件, 'twitter.embeddings_64', 是调用DeepWalk包生成的. 你可以参考 'load_data_twitter()' 这个函数,在data_load.py文件里. 如果你想从 Twitter数据集里提取subgraph, 可以使用提供的'Extract_graph()'这个函数. 为带来的不便非常抱歉!

@TianxiangZhao
Copy link
Owner

twitter_fake_ids.cvs我发现过期了,刚刚加到了data这个文件夹里

@cheng-zhimin
Copy link
Author

cheng-zhimin commented Feb 24, 2023 via email

@cheng-zhimin
Copy link
Author

cheng-zhimin commented Feb 24, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants