<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Aditya Ganeshan on Medium]]></title>
        <description><![CDATA[Stories by Aditya Ganeshan on Medium]]></description>
        <link>https://medium.com/@Bardofcodes?source=rss-a4a795f13638------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*xJEOEPLfegBEuosqvCbO_w.jpeg</url>
            <title>Stories by Aditya Ganeshan on Medium</title>
            <link>https://medium.com/@Bardofcodes?source=rss-a4a795f13638------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Fri, 20 Nov 2026 09:00:26 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@Bardofcodes/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Adversarial Attacks & Defenses at CVPR 2019]]></title>
            <link>https://medium.com/@Bardofcodes/adv-ac2c5a9bc639?source=rss-a4a795f13638------2</link>
            <guid isPermaLink="false">https://medium.com/p/ac2c5a9bc639</guid>
            <category><![CDATA[adversarial-attack]]></category>
            <category><![CDATA[deep-learning]]></category>
            <category><![CDATA[cvpr]]></category>
            <category><![CDATA[computer-vision]]></category>
            <category><![CDATA[machine-learning]]></category>
            <dc:creator><![CDATA[Aditya Ganeshan]]></dc:creator>
            <pubDate>Tue, 18 Jun 2019 06:29:23 GMT</pubDate>
            <atom:updated>2019-06-19T04:36:26.542Z</atom:updated>
            <content:encoded><![CDATA[<p><em>Analyzing the trends in Adversarial A&amp;D at the IEEE Conference on Computer Vision and Pattern Recognition 2019. This post is supported by a more in-depth summary of papers published at CVPR over the years </em><a href="https://github.com/BardOfCodes/adv_summaries"><em>here</em></a><em>.</em></p><p>In this post, I will be presenting the recent trends in adversarial Attacks and Defenses at <em>CVPR’19</em>. I hope this high-level analysis increases your awareness of the exciting new results, and perhaps motivate you to pursue specific directions within this field. <strong>TL;DR</strong> key-points are: (a) better attacks and significantly stronger defense strategies than <em>CVPR’18</em>, (b) new tasks have been attempted such as <em>targeted caption generation</em>, and ( c ) Scores of papers on attacking <strong>3D</strong> data such as meshes and point clouds.</p><p>A brief look at the news would inform you about the boom in the field of Artificial Intelligence, be it in research or application. With such a exponential growth in this field, problems which were (re)introduced only a few years ago have became vast sub-fields in themselves . This post deals with one such topic: Adversarial Attacks and Defenses. While this sub-field expands beyond the domain of vision; in this post, we will be looking at the recent trends of Adversarial Attacks &amp; Defenses by exploring one of the most impact computer vision conferences:<em> IEEE Conference on Computer Vision and Pattern Recognition (CVPR)</em>, 2019.</p><p><strong><em>Note</em></strong><em>: This post assumes a basic understanding of adversarial attacks &amp; defenses. Check out these amazing blogs (</em><a href="https://medium.com/onfido-tech/adversarial-attacks-and-defences-for-convolutional-neural-networks-66915ece52e7"><em>a</em></a><em>, </em><a href="https://medium.com/mlreview/the-intuition-behind-adversarial-attacks-on-neural-networks-71fdd427a33b"><em>b</em></a><em>, and </em><a href="https://openai.com/blog/adversarial-example-research/"><em>c</em></a><em>) if you are unfamiliar with this topic!</em></p><h3>Increasing papers on Adversarial Attacks &amp; Defenses</h3><iframe src="https://cdn.embedly.com/widgets/media.html?url=https%3A%2F%2Fplot.ly%2F%7Ebardofcodes%2F1%2F&amp;src=https%3A%2F%2Fplot.ly%2F%7Ebardofcodes%2F1.embed%3Fautosize%3Dtrue&amp;type=text%2Fhtml&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;schema=plot" width="600" height="400" frameborder="0" scrolling="no"><a href="https://medium.com/media/66c0fe898be9e3ca17b62322ccfe2a07/href">https://medium.com/media/66c0fe898be9e3ca17b62322ccfe2a07/href</a></iframe><p>The graph above shows the overall number of papers and the number of papers related to adversarial A&amp;D accepted at <em>CVPR</em> over the past 4 years. For adversarial A&amp;D, from <strong>8</strong> papers at <em>CVPR’18</em> to <strong>33</strong> papers at <em>CVPR’19</em>, there is an impressive growth. While the total paper count has increased by ~<strong>30%</strong>, papers in adversarial A&amp;D increased by over <strong>400%</strong>! Furthermore, <strong>4 </strong>different workshops related to adversarial A&amp;D are being held at <em>CVPR’19</em>. What this trend indicates is the increase in the research input, from academia as well as industry. Having invested a sizable amount of time and effort during the past <strong>2</strong> years in pursuing research ideas in this field, I have frequently considered the following question: <em>Why is the academia, private industry and government investing time, efforts and money in this field?</em></p><p>I consider it to be broadly due to two dominant factors:</p><ol><li><strong><em>Exposing and assuaging the threat to AI Solutions deployed in critical procedures</em></strong><em>: </em>For deploying a deep-learning based solution in critical procedures such as autonomous driving or surgical systems, it is essential to address its susceptibility to adversarial perturbations. Systems participating in such critical procedures need strong security measures against disruptive acts from nefarious agents.</li><li><strong><em>Exposing the gap in our current understanding of ‘learning’</em></strong>: Current neural networks architectures are only weakly modeled after our biological neural systems. However, our current learning algorithms are our best approximations to how humans ‘<em>learn</em>’. Adversarial attacks expose the inherent difference between model fitting and the human ‘<em>learning</em>’ as we ourselves do not face this problem (although we do have a different set of adversaries: <a href="https://visme.co/blog/best-optical-illusions/">visual illusions</a>).</li></ol><p>While curiosity definitely plays a role, it’s undeniable that the potential impact of this field acts as a motivating factor as well. Now, its time to look into what these research inputs have led to.</p><h3><strong>Trends in CVPR 2019</strong></h3><iframe src="https://cdn.embedly.com/widgets/media.html?url=https%3A%2F%2Fplot.ly%2F%7Ebardofcodes%2F3%2F&amp;src=https%3A%2F%2Fplot.ly%2F%7Ebardofcodes%2F3.embed%3Fautosize%3Dtrue&amp;type=text%2Fhtml&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;schema=plot" width="600" height="400" frameborder="0" scrolling="no"><a href="https://medium.com/media/bb42c4d0d92c59eab94f12a93347fcad/href">https://medium.com/media/bb42c4d0d92c59eab94f12a93347fcad/href</a></iframe><p>The above pie chart distributes all the <strong>33</strong> papers into <strong>5</strong> semantically similar bins. A big chunk of works are centered around defense against adversarial attacks. Surprisingly, there are <strong>6</strong> new works on attacking <strong>3D</strong> data such as meshes, voxels etc!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/784/1*t1DwWKoy0WRy0-gq1kxk8Q.png" /><figcaption>In Curl and Whey, gradient ascent allows us to find <strong><em>xA</em></strong>. Simple iterative gradient descent would lead to a distant adversarial sample <strong><em>xB</em></strong>.</figcaption></figure><p>At <em>CVPR’19</em>, more than <strong>7</strong> new attacks have been proposed which deal with image classification. Works such as [<a href="https://arxiv.org/abs/1812.06371">22</a>, <a href="https://arxiv.org/abs/1904.02884">24</a>, <a href="https://arxiv.org/abs/1811.09600">27</a>] introduced improved optimization for crafting perturbations. <a href="https://arxiv.org/abs/1811.02248"><strong>SparseFool</strong></a>, a method from <em>Dezfooli et al.</em>, builds on top of their previous attack methods <a href="https://arxiv.org/abs/1511.04599"><strong>DeepFool</strong></a>, producing sparse yet lethal perturbations. In <a href="https://arxiv.org/abs/1904.01160"><strong>Curl and Whey</strong></a>, <em>Shi et al.</em> introduce a novel idea that ‘<em>curling</em>’, i.e. using gradient descent as well as ascent, can yield stronger black-box perturbations (quick timeout: <em>White-box</em> attack refers to attacks with intrinsic knowledge of the system; in this case, parameters of the neural network and <em>black-box</em> attacks refer to attacks <em>without</em> such knowledge). When combined with a denoising ‘<em>whey</em>’ iteration, this method yields one of the strongest black box attacks known. Curl and Whey perturbations achieve comparable results to existing attacks while being <strong>~30%</strong> smaller than other perturbations. Finally, in <a href="http://openaccess.thecvf.com/content_CVPR_2019/html/Ho_Catastrophic_Childs_Play_Easy_to_Perform_Hard_to_Defend_Adversarial_CVPR_2019_paper.html"><strong>Catastrophic Child’s Play</strong></a>, <em>Ho et al.</em> propose an attack formulation where the object or the camera is manipulated in real life, and show that none of the existing defense mechanisms sufficiently improve predictions from such images.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/828/1*mQ3q_z3A5ZIETk_0qsPxtA.png" /><figcaption>In<strong> Stratified… Coding</strong>, a the Neural Network is trained with input from a Quasi-natural Image space. A Sparse Transformer Layer projects adversarial samples <strong>Xadv </strong>to this space <strong>T(Xadv)</strong>. This projection, when taken as input by the Neural Network, gives higher representations, which are not far from the clean image’s higher representations.</figcaption></figure><p>When it comes to defenses, the works are aplenty. Significant strides have been made in defense against white as well as black-box attack in works such as <a href="http://openaccess.thecvf.com/content_CVPR_2019/html/Xie_Feature_Denoising_for_Improving_Adversarial_Robustness_CVPR_2019_paper.html"><strong>Feature Denoising</strong></a><strong> </strong>from <em>Xie et al.</em> and <a href="https://arxiv.org/abs/1803.05787"><strong>Feature Distillation</strong></a><strong> </strong>from <em>Liu et al</em>. For example, Feature Denoising<strong> </strong>increases top-1 accuracy of <em>Resnet-152 </em>against strong white-box attacks from <strong>27.9%</strong> to <strong>55.7%</strong>! New methods such as <a href="https://arxiv.org/abs/1812.00037"><strong>Stratified Convolutional Sparse Coding</strong></a>, and <a href="https://arxiv.org/abs/1811.12673"><strong>ComDefend</strong></a><strong> </strong>seek to denoise/reproject the adversarial image to clean image manifold before passing it to the target network. In contrast, works such as <a href="https://arxiv.org/abs/1811.09310"><strong>Parametric Noise Injection</strong></a><strong> </strong>present novel methods for adversarial training. Finally, few of the papers such as <a href="http://openaccess.thecvf.com/content_CVPR_2019/html/Raff_Barrage_of_Random_Transforms_for_Adversarially_Robust_Defense_CVPR_2019_paper.html"><strong>BaRT</strong></a><strong> </strong>from <em>Raff et al.</em> and <a href="https://arxiv.org/abs/1904.00689"><strong>Randomized Diversification</strong></a><strong> </strong>from <em>Taran et al.</em> utilize randomization as a key component of their defense strategy.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/620/1*n8ZesCTrmBZh7KdXeai7JQ.png" /><figcaption>Attacking image captioning systems to generate target partial captions.</figcaption></figure><p>A big change this year has been regarding the different types of tasks that have been attacked. In [<a href="https://arxiv.org/abs/1905.04016">33</a>], authors <em>Xu et al.</em> present novel optimization methods for yielding target partial captions (as shown in the adjacent image) from images. Works such as <a href="https://arxiv.org/abs/1904.08653"><strong>Fooling automated surveillance cameras</strong></a> from <em>Thys et al.</em> yield a printable patch which enables the person holding the patch to avoid detection from any angle and position (results in the video below). Further, [<a href="https://arxiv.org/abs/1903.01612">30</a>, <a href="https://arxiv.org/abs/1802.09502">34</a>] leverage Image Retrieval to provide an effective defense against black box attacks. Finally, in [<a href="https://arxiv.org/abs/1904.04433">31</a>], <em>Dong et al.</em> present a powerful evolutionary algorithm for attacking Face Recognition systems in a black box setting. This is further utilized to successfully attack <strong>TenCent’s Face Verification Platform</strong>.</p><iframe src="https://cdn.embedly.com/widgets/media.html?src=https%3A%2F%2Fwww.youtube.com%2Fembed%2FMIbFvK2S9g8%3Ffeature%3Doembed&amp;url=http%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3DMIbFvK2S9g8&amp;image=https%3A%2F%2Fi.ytimg.com%2Fvi%2FMIbFvK2S9g8%2Fhqdefault.jpg&amp;key=a19fcc184b9711e1b4764040d3dc5c07&amp;type=text%2Fhtml&amp;schema=youtube" width="640" height="480" frameborder="0" scrolling="no"><a href="https://medium.com/media/d7b1b9e4e7d68cf9543a4ed271f76cb4/href">https://medium.com/media/d7b1b9e4e7d68cf9543a4ed271f76cb4/href</a></iframe><p>While the above works primarily present an attack or a defense, works such as [<a href="http://openaccess.thecvf.com/content_CVPR_2019/html/Corneanu_What_Does_It_Mean_to_Learn_in_Deep_Networks_And_CVPR_2019_paper.html">41</a>, <a href="https://arxiv.org/abs/1812.00740">42</a>, <a href="https://arxiv.org/abs/1811.09716">43</a>] explore the underlying reasons for the existence of adversarial A&amp;D. In [<a href="http://openaccess.thecvf.com/content_CVPR_2019/html/Corneanu_What_Does_It_Mean_to_Learn_in_Deep_Networks_And_CVPR_2019_paper.html">41</a>], <em>Corneanu</em> <em>et al</em>. provide a novel definition of what ‘<em>learning</em>’ actually means. In contrast, works such as [<a href="https://arxiv.org/abs/1812.00740">42</a>, <a href="https://arxiv.org/abs/1811.09716">43</a>], focus on the learnt space and decision boundaries.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/795/1*nh_BSU0UaChHyGAJX8KI7g.png" /><figcaption>In <strong>Adversarial Attacks Beyond the Image Space</strong>, loss-increasing gradients are back propagated to the object rather than the 2D image render, using which the 3D scene is modified to produce adversarial samples.</figcaption></figure><p>Finally, there has been a deluge of interest in attacking <strong>3D</strong> data. This has definitely been enabled by the invention of <a href="https://medium.com/@jcowles/differentiable-rendering-d00a4b0f14be">differentiable rendering techniques</a> in the past few years. While about half the works [<a href="https://arxiv.org/abs/1809.07016">36</a>, <a href="https://arxiv.org/abs/1810.05206">37</a>, <a href="http://openaccess.thecvf.com/content_CVPR_2019/html/Xiao_MeshAdv_Adversarial_Meshes_for_Visual_Recognition_CVPR_2019_paper.html">38</a>, <a href="https://arxiv.org/abs/1904.00923">39</a>] attack the system by changing the object structure itself (mesh or voxel or point cloud), others [<a href="https://arxiv.org/abs/1711.07183">35</a>, <a href="https://arxiv.org/abs/1811.11553">40</a>] craft adversaries by changing illumination or pose of object. These works open up multiple methods to attack <strong>3D</strong> data and raise concerns regarding utilizing <strong>3D </strong>data reliant pipelines in critical activities such as autonomous driving.</p><p>Some of the other minor trends are shown below in the chart:</p><iframe src="https://cdn.embedly.com/widgets/media.html?url=https%3A%2F%2Fplot.ly%2F%7Ebardofcodes%2F5%2F&amp;src=https%3A%2F%2Fplot.ly%2F%7Ebardofcodes%2F5.embed%3Fautosize%3Dtrue&amp;type=text%2Fhtml&amp;key=d04bfffea46d4aeda930ec88cc64b87c&amp;schema=plot" width="600" height="400" frameborder="0" scrolling="no"><a href="https://medium.com/media/5f04cb7a31075a22b7b3bf9f00f01960/href">https://medium.com/media/5f04cb7a31075a22b7b3bf9f00f01960/href</a></iframe><p><strong>Closing Remark</strong>:<br>In day to day research, we are generally bogged down by specific problems in specific domains. I hope this mini-survey helps you to take a broader view of adversarial A&amp;D and the recent exciting works. Maybe you will join some dots between your research and one of the works mentioned above, and take a leap into adversarial A&amp;D as well! I will be very interested to know which paper you liked the most and why.</p><p>I am keeping a more in-depth summary of each of the adversarial A&amp;D work at <em>CVPR</em> at <a href="https://github.com/BardOfCodes/adv_summaries">this repository</a>. Check it out for more detailed, yet less wordy paper summaries (i.e. ~<strong>5–7</strong> lines per paper). I am still only halfway through with the papers, but hopefully it will be finished soon.</p><p>I’d be thankful if you inform me about any errors in this post. I’ll be sure to send you some adversarial money. Finally, <em>CVPR</em> alone is perhaps quite a small subset to analyze trends on. In future, I hope to include more conferences as they come along.<br><a href="https://github.com/BardOfCodes/adv_summaries/blob/master/README.md">Link to pseudo-bibliography</a></p><h4>Acknowledgement:</h4><p>A lot of times, we make grand plans for writing and publishing, only to bail out or to push it into a loop of endless procrastination. It took me 6 months of random musing to finally pen down something concrete. This could have easily stretched into, and beyond, the next <em>CVPR,</em> were it not for discussion with <a href="https://medium.com/@kevinconnolly">Kevin Connolly</a> on writing and information sharing. A big shoutout to Kevin!</p><p>I am also grateful to my sister <a href="https://www.instagram.com/aishwaryaganeshan/">Aishwarya</a>, <a href="https://in.linkedin.com/in/tathagata-sengupta-93297064">Tathagata</a> and Kevin for the amazing editorial feedback!<br>Thanks to <a href="https://www.linkedin.com/in/gananathmisra/?originalSubdomain=in">Gannanath Misra</a> for suggesting subtitle revision.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=ac2c5a9bc639" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>