Giter VIP home page Giter VIP logo

eulertemporallp's Introduction

Euler: Detecting Network Lateral Movement via Scalable Temporal Graph Link Prediction

The code powering the Euler Temporal Link Prediction framework (Published in NDSS'22)

Abstract

Lateral movement is a key stage of system compromise used by advanced persistent threats. Detecting it is no simple task. When network host logs are abstracted into discrete temporal graphs, the problem can be reframed as anomalous edge detection in an evolving network. Research in modern deep graph learning techniques has produced many creative and complicated models for this task. However, as is the case in many machine learning fields, generality of models is of paramount importance so as to achieve good accuracy and scalability in training and inference.
We propose a formalized version of this approach in a framework we call Euler. It consists of a model-agnostic graph neural network stacked upon a model-agnostic sequence encoding layer such as a recurrent neural network. Models built according to the Euler framework can easily distribute their graph convolutional layers across multiple machines for large performance improvements. We demonstrate that Euler-based models are competitive, or better than many state-of-the-art approaches to anomalous link prediction. As anomaly-based intrusion detection systems, Euler models can efficiently identify anomalous connections between entities with very high precision and outperform other unsupervised techniques for anomalous lateral movement detection.

Motivation

The current state of the art in temporal link prediction with graph neural networks uses an inefficient architecture. Almost every paper we could find in this field uses a GNN combined with an RNN in such a way where the GNN input is dependant on the RNN output, as shown below:

Our framework separates the two such that GNNs are free to run independantly. In this way, they can be distributed across multiple machines for large performance improvements

This framework is scalable to large datasets, and is much faster than every other temporal link prediction method we tried, while retaining similar, or better precision and AUC.

)

eulertemporallp's People

Contributors

zazyzaya avatar

Watchers

 avatar  avatar  avatar

eulertemporallp's Issues

Can you provide us a small sample of the LANL dataset you used in the work?

Hello. Firstly, thanks for sharing the source code. There is any version of your paper on Arxiv? Besides, I would stay quite grateful if you provide a small sample of the LANL dataset you used in the work.

Secondly, could you explain the "nmap.pkl" on this line from load_lanl.py?

nm = pickle.load(open(LANL_FOLDER+'nmap.pkl', 'rb'))

nm = pickle.load(open(LANL_FOLDER+'nmap.pkl', 'rb'))

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.